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THIS  REPORT  CONCERNS  . 


An  investigation  of  the  reliability  and  validity  of  the  assess¬ 
ment  interview  in  the  screening  and  selection  of  enlisted  personnel  for 
the  submarine  service. 


IT  IS  FOR  THE  USE  OF  ...  . 

Submarine  medical  officers,  personnel  officers,  and  psycholo¬ 
gists  who  are  concerned  with  the  interview  and  other  related  .election 
problems. 


THE  APPLICATION  FOR  SUBMARINE  MEDICINE  .... 

Will  be  in  the  revison  of  assessment  procedures,  the  training 

of  prospective  medical  officer  interviewers,  the  guidance  of  those  re¬ 
sponsible  for  assessment  and  as  a  source  of  ideas  for  further  research 
in  this  area. 
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abstract 

This  report  is  the  lest  of  tour  reports  in  connection  with  re¬ 
scorch  on  the  problem:  "The  reliobility  and  veiidity  ot  the  ossessnnen. 
Interview  os  o  screening  end  selection  technique  in  the  submortne 

service”. 

One  hundred  end  nine  interviews  were  recorded  ond  onolyced 
for  content,  spooking  time  potterns  end  both  intre-r.ter  end  mter-reter 
reliobility.  Six  hundred  end  eighty-twc  interview  decisions  were  , eneiyned 
tor  veiidity  egoinst  on  immediete  criterion  ot  p.ss-to.l  :n  the  asi 
merine  Schooi.  ot  the  Submerine  Bose,  New  London.  Connecticut. 

Content  enelysis  reveeled  high  consistencies  for  items  pertain- 

ing  to  interest  in  submoriners  ond  foctuol  type  per.onel  h, story  items 
However,  the  letter  are  j.dged  to  be  ot  questionable  assessment  vein, 
in  the  light  of  the  low  consistencies  in  the  coverage  of  related  ntt.tud.na 

,vpc  items.  Time  analysis  revealed  the  need  for  letting  the  tnterv.ewee 
do  more  of  the  talhing.  Both  intra-rater  and  in.er-rater  reliability  are 

high,  but  considerable  variation  is  indicated  in  the  standards  and  report¬ 
ing  of  compiled  individual  traits.  Validity  of  the 

is  high  for  the  overall  decision  of  acceptance  or  re, ect.on  for  Basic 
marine  Schooi,  but  this  is  partially  an  artifac.of  an  unusually  high  selec- 

tion  ratio. 
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THE  INTERVIEW 

IV.  THE  RELIABILITY  AND  VALIDITY  OF  THE  ASSESSMENT 
INTERVIEW  AS  A  SCREENING  AND  SELECTION 
TECHNICUE  IN  THE  SUBMARINE  SERVICE 

INTRODUCTION 

The  problem  of  screening  and  .electing  submariners  ha.  long 
been  a  concern  to  the  Navy.  Continual  development  and  appraisal  of 
screening  and  selection  techniques  are  made  at  the  U.S.Naval  Medical 
Research  Laboratory.  New  London.  Connecticut.  However,  because  of 
a  lack  of  sufficient  specialized  personnel  at  the  Laboratory,  relatively 
Utile  attention  had  been  given  to  the  evaluation  and  improvement  of  the 
assessment  interview  since  World  War  II.  Consequently,  aprogramfor 
the  reactivation  of  research  on  the  assessment  interview  was  undertaken 
in  March  1 95 1  as  a  collaborative  effort  of  the  U.S.Naval  Medical  Research 
Laboratory  and  a  group  of  investigators  at  Fordham  University. 

Before  focussing  on  a  study  of  the  assessment  interview  as  con¬ 
ducted  at  the  Laboratory,  it  is  important  to  set  it  in  its  proper  place  and 
backgro-_d  in  the  entire  screening  and  selcctionprocedure.  Candidates 
for  submarine  service,  a  group  comprised  typically  of  volunteer  re¬ 
cruits  and  of  volunteer  and  recommended  surface  ship  men,  must  sub¬ 
mit  to  various  test  hurdles  as  sketched  in  Figure  l,(page  2)before  they 
qualify  as  submariners.  It  should  be  pointed  out  that,  whereas  all 
candidates  undergo  examination  at  the  stages  up  to  and  including  the 
interview,  only  those  who  are  accepted  on  the  basis  of  the  interview, 
go  on  to  Basic  Submarine  School.  Then  only  those  who  pass  Basic  Sub¬ 
marine  School  may  go  on  to  Advanced  Submarine  School,  if  assigned,  or 
aboard  the  submarines.  Finally,  only  those  who  qualify  after  a  period 
aboard  the  submarines  are  accorded  the  submariner  status. 


which: 


The  assessment  interview,  therefore,  represents  the  point  at 
(1)  All  previously  gathered  data  on  the  candidate  are  scrutinized 


•  j.  u  .  t  f 
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Figure  1.  -  Hurdle*  in  the  screening  and  •  election  of  Candida  to*  for  the 
submarine  service. 


by  Medical  Officer  interviewers  for  their  agreement  with  the  standards 
of  acceptance  in  each  preceding  area  of  examination;  (2)  Judgment  is 
mode  by  Medical  Officer  interviewers  of  personal  and  social  adjust¬ 
ment  as  well  as  motivation  for  submarine  service;  (3)  An  overall  decision 
is  made  by  the  Medical  Officer  interviewers  regarding  the  filness  of 
each  candidate  to  advance  to  Basic  Submarine  School.  The  interview 
report  form  which  had  been  in  use  at  the  Medical  Research  Laboratory 
upon  the  activation  of  the  present  investigation  is  exhibited  as  Appendix 
A. 

It  can  be  noted  that  (2)  above  represents  that  function  of  the 
interview  which  is  most  independent  of  the  factors  examined  at  other 
hurdles.  In  other  words,  the  assessment  interview  provides  the  relative¬ 
ly  unique  opportunity  to  view,  probe  and  judge  the  candidate  with  regard 
to  personal  and  social  adjustment  traits  and  to  evaluate  his  interest, 
aptitude  and  motivation  for  submarine  service. 

PURPOSE 

Indications  from  previous  studies  at  the  Medical  Research 
Laboratory  have  pointed  to  the  fact  that  men  who  fail  to  qualify  for  the 
submarine  service  are  not  dismissed  as  much  for  inadequacies  in  apti¬ 
tude  and  achievement  as  for  inadequacies  in  personal  and  social  adjust¬ 
ment.  The  problem,  then,  of  evaluating  the  effectiveness  of  th'  assess¬ 
ment  interview  is  essentially  one  of  accepting  or  rejecting  the  follow¬ 
ing  basic  hypotheses: 

Hypothesis  1.  Prospective  submariners  have  personal  and  social 
adjustment  traits  which  are  differentiable  within  the  group. 

Hypothesis  2.  Differences  in  personal  end  social  adjustment 
traits  exist  between  those  likely  to  succeed  and  those  likely  to  fail  in 
the  submarine  service. 

Hypothesis  3.  These  personal  and  social  adjustment  traits  are 
observable  and  ratable  in  the  assessment  interview  eituation. 

In  order  to  test  these  hypotheses,  the  projected  research  was 
aimed  at  solving  the  following  specific  problems: 


3 


A.  Background  Survey  of  the  Literature 


What  are  the  findings,  civilian  and  military,  on  the  interview 
as  a  screening  and  selection  technique? 

B.  Reliability 

1.  How  consistent  is  the  interview  content? 

2.  How  consistent  is  the  pattern  of  interviewee  and  inter¬ 
viewer  speaking  time? 

3.  How  consistent  are  each  interviewer’s  judgments? 

4.  How  consistent  are  each  interviewer’s  judgments  with 
those  of  other  interviewers? 

5.  How  reliable  are  the  instruments  which  are  in  use  as  aids 


to  the  interviewer? 


C.  Validity 


1.  How  well  does  the  interview  predict  success  in  the  sub¬ 
marine  school ? 

2.  How  well  does  the  interview  differentiate  the  disqualified 
from  those  who  qualify  on  board  submarines? 

3.  How  well  does  the  interview  relate  to  other  predictors' 

4.  How  valid  are  the  instruments  which  are  in  use  ns  aids 
to  the  interviewer? 


D.  Isolation  of  relevant  traits 

1.  What  are  the  traits  relevant  to  success  in  submarines? 

2.  What  evidence  exemplifies  the  presence  and  quantity  of 
each  trait? 

Clearly,  these  are  the  continuing  problems  which  arc  inherent 

in  an  evaluation  of  interview  procedures.  As  a  result,  answers  to  these 

questions  which  may  be  definitive  for  a  given  period  of  time  must 

periodically  be  re-examined  and  re-appraised,  and  procedures  must  be 

revised  in  the  light  of  the  findings.  It  was  anticipated,  therefore,  that, 

T  It  was  not  possible  to  explore  these  questions  during  the  period  of  the 
present  investigation  due  to  the  unavailability  of  criterion  data  from  the 
submarines. 
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although  the  present  investigation  may  not  be  able  to  provide  full  replies 
to  oil  these  questions  for  the  period  under  study,  i  would  spell  out  the 
pattern  for  the  conduct  of  continuing  research  by  the  Medical  Research 
Laboratory. 

PROCEDURE 

For  each  question  posed  in  the  preceding  section,  and  parallel¬ 
ing  the  organization  and  numbering  sequence  there,  an  account  of  the 
appropriate  research  designs  which  were  adopted  is  given  in  this  section. 

i i .  Background  S urvey  of  the  Literature 

A  systematic  and  comprehensive  survey  of  the  civilian  and 
military  literature  on  the  interview  and  on  aspects  of  the  submarine 
frame  of  reference  was  undertaken.  Materials  were  reviewed  through 
April  1952.  One  hundred  fifty-six  titles,  read  and  deemed  most  perti¬ 
nent  to  the  present  investigation,  were  abstracted;  twenty-seven  titles 
which  were  read  and  considered  of  possible  interest  in  kindred  research, 
were  listed.  These  abstracts  and  titles  were  incorporated  into  a  sepa¬ 
rate  initial  report  entitled,  “The  Interview  :  I.  A  Selectively  Abstracted 
Bibliography. “  Three  indexes  facilitating  entry  to  the  titles  by  author, 
by  subject  and  by  journal  were  appended. 

B.  Reliability 

To  determine  the  consistency  of  interview  content,  and  of 
interview  speaking  time  patterns,  and  the  intra-and  inter-rater  relia¬ 
bility  of  the  judgments  made  in  the  interview,  the  research  design  in¬ 
volved  the  collection  of  soundscr ipts.  Interviews  by  Medical  Officer 
interviewers  with  candidates  for  the  submarine  service  at  the  Medical 
Research  Laboratory  were  recorded  during  the  period  15  March  1951  to 
15  July  1951.  Special  instructions  to  the  recorder  calling  for  strict 
random  selection  of  interviews  to  be  recorded  proved  to  be  unfeasible 
due  to  such  difficulties  as  “turnover  in  interviewers,"  periodicity  of  the 
interview  schedules,  and  equipment  limitations  in  that  the  recording 
circuit  comprised  several  microphones  wired  to  a  single  tape  recorder. 
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Instead,  interviews  were  recorded  at  the  discretion  and  judgment  of  the 
recorder  who  made  use  of  such  considerations  as  daily  and  weekly 
interview  loads,  the  number  of  interviews  currently  gathered  for  each 
interviewer,  and  the  like. 

Interviewers  and  interviewees  did  not  realize  that  recordings 
were  being  taken  at  a  particular  time.  However,  the  Medical  Officer 
interviewers  had  been  briefed  concerning  the  study  and  its  general 
methodology.  They  admitted  to  some  conscious  awareness  of  the  possi¬ 
bility  of  being  tuned  in  on  only  in  the  early  weeks.  Of  course,  it  is  diffi¬ 
cult  to  estimate  the  influence  of  the  interviewers’  knowledge  of  the  study 
in  progress  on  the  plan  to  obtain  a  fair  sampling  of  the  assessment 
interview  as  it  was  being  conducted  at  the  Medical  Research  Laboratory 
upon  activation  of  the  present  research.  While  it  is  viewed  as  a  factor 
which  would  tend  to  improve  the  pattern  of  conducting  the  interview 
progressively  by  the  direction  of  more  conscious  effort  and  attention, 
its  exact  influence  remains  uncvaluatcd. 

/is  far  as  the  method  of  collecting  the  soundscripts  is  concerned, 
then,  no  serious  biasing  factor  could  be  foreseen.  By  15  July  1951,  one 
hundred  nine  interviews  had  been  recorded  in  an  audible  manner  and 
these  interviews  involved  six  interviewers.  This  recorded  sample  con¬ 
stitutes  the  one  on  which  the  present  procedures  and  findings  on  reli¬ 
ability  are  based. 

To  check  on  the  representativeness  of  this  sample,  which  in/cr- 
entially  would  yield  a  check  on  the  representativeness  of  the  findings, 
data  were  gathered  on  selected  variables  for  the  total  “population”  pro¬ 
cessed  during  the  period  15  March  1951  to  15  July  1951.  The  character¬ 
istics  of  the  total  ’’population”  on  these  selected  variables  were  then 
compared  with  the  characteristics  of  the  recorded  sample  and  also 
with  those  of  the  remainder,  or  unrecorded,  sample. 

The  first  variable  requiring  this  check  was  that  of  interviewers: 
Were  the  interviewers  in  the  soundscript  sample  represented  in  the 
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c  ..  v  werc  in  the  interviewing  of  the  total 

P‘-°Portion6  1  cre  Thc  frequency  end  percenter 

"population"  of  submar.ne  eenu.detce?  The  ,  ,  blslow 

of  interview  Iced  for  end,  interv.ewer  ere  set  forth 

for  each  of  the  three  interviewed  groups. _ ^ 

— .  ■■  -^ir*** ~  r  intnrvicw  lo&d  reflected  ior 

Table  1.-  Frequency  and  P*r.CC^Be  ul  ..population”,  recorded  and 
six  interviewers*  in  the  to \*d  p  .  the  period  15  March 
unrecorded  interviewed  groups  during  ^  _ _ 

1951  tolb  July  1951  - rnlorview'ca= - Etervlewed^- 


Interviewer 

Code 


“Interviewed 

.•Population” 

"N  1'  oi  N~ 


Tntcrvvewe  cl- 
Recorded 

N  of  N 


IntcrvTewed- 

Unrecorded 

N  %  of  N 


Totals  980 

—  •  t  r viewers  were  involved  in  the  population 

.  At  ie.s,  e|HlculUe.  the  soundscripts  cottected  on 

interviewed.  Due  6  ^  ,nlm(!ible .  end  eliminated  from  the 

lhcse  -.ervewer  h  based  „„  ,olals  involvin*  the  six 

study,  audible  soundscrip.s  were  obtained.  They  are 

interviewers  from  wr  h&sed  on  an  additional 

unrepresentative  to  the  extent  that  they  intcrvicwers  who 

102  “rri  rPeriod  ulr  study.  Inclusion  of 

did  from  8  to  53  ^  ^  the  gencral  interpretation^!  tl.e 

^  ^  5  y 

in  relation  to  one  another. 

-  ::  rrr ; 

the  numbC'  J  with  the  general  interview  load  each  of  these 


viewer  falls  into  the  same  rank  position  in  interview  load,  and  there 
are  no  more  than  three  percentage  points  of  discrepancy  in  the  exact  per¬ 


centages  of  the  load. 


Two  other  variables  regarding  naval  status  and  the  related 
factor  of  age  were  also  examined:  (1)  Were  the  interviewees  in  the  record¬ 
ed  sample  distributed  in  the  same  proportion  by  the  branches  of  the 
Navy,  by  pay  grade  and  by  age  as  they  were  in  the  total  ‘'population"? 
The  frequencies  and  percentages  of  the  cases  for  each  of  tnc  three 
interviewed  groups  in  each  branch  of  the  Navy,  in  each  pay  grade  and 
in  given  age  groups  are  presented  in  Table  2,  below: 


TaEl~27-"Trequency  and  per  cenTof  cases  di s t rlbutcd  by  bra nch  of  the' 
Navy,  pay  grade  ar.d  age  in  the  total  “population  ,  creed  _ 
and  unrecorded  groups  during  the  period  15  March  1951  to  15 


July  1951 


Interviewed 

“Population" 

Interviewed 

Recorded 

Branch  of  Navy 

TI - 

P 

>  ofNp 

r 

— u.sttt: 

"575 

9t> 

bo 

U.S.N.R. 

16 

2 

8 

7 

Unidentified 

20 

3 

8 

7 

Totals 

682 

109 

- 

Interviewed 

Unrecorded 

IT— ~T.-oTTT 

■553  W~~ 

8  1 

12  2 

573 


Pay  Grade 

5A,  Jt  A,  i  A 

JTT~~ 

~5F 

SN,  FN,  TN 

125 

18 

P03 

72 

1 1 

P02 

27 

4 

POl 

21 

3 

CPO 

10 

1 

Unidentified 

Totals 

30 

682 

4 

bb 

- 51 - 

TH - 

— W 

23 

21 

102 

18 

17 

16 

55 

10 

3 

3 

24 

4 

2 

2 

19 

3 

« 

10 

2 

t. 

7 

22 

4 

:09 

573 

Age 


16-20  423 

21-25  188 

26-29  39 

31-35  4 

Unidentified  ZS 

Totals  682 


62  64  59 

28  33  30 

6  4  4 

1  0 

5  _ 8_  ” 

109 


359  63 

155  27 

35  6 

4  1 

20  3 


8 
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Hero  again,  it  can  be  seen  that  the  representation  of  candidates 
in  the  recorded  sample  by  branch  of  the  Navy,  by  pay  grade  and  by  age 
aligns  itself  very  favorably  with  these  characteristics  of  the  total 

••population”.  There  are  no  more  than  ten  percentage  points  discrepancy 

for  these  three  variables.  This  discrepancy  is  in  the  case  of  the  branch 
of  Navy,  and  shows  a  somewhat  lesser  representation  of  regular  Navy 
personnel  in  the  soundscript  sample  than  in  the  “population”  group. 
Finally,  these  groups  were  compared  for  performance  in  various  psy¬ 
chometric  measures.  The  means  and  standard  deviations  on  the  meas¬ 
ures  for  the  total  “population”,  recorded  and  unrecorded  samples  are 
given  in  Table  3,  below; 


3‘"  m  and.6,  n,dard  deviatlons  of  GCT,  Arithmetic  and 
Mechanical  test  scores  for  the  total  "population”, recorded 
andi  unrecorded  gr°Ups  durin8  the  period  15  March  1951 

Tt‘Sl  Interviewed^  Interviewed-  “interviewed 

Population  Recorded  Unrecorded 


GCT 


Mean 

S.D. 

N 


Arithmetic  Mean 
S.D. 
N 

Mechanical  Mean 
S.D. 

N 


60.51 

6.60 

664 

57.98 

6.68 

664 

55.45 

7.74 

658 


61.16 

6.50 

101 

58.84 

6.68 

101 

55.92 

7.29 

101 


60.35 

7.17 

563 

57.98 

6.68 

563 

55.37 

7.81 

558 


Based  on  the  available  data,  making  the  assumption  that  scores  for 
te'rp'cUtio  n.  °m  d'““  WCre  mi££ins  would  "°l  •>««  changed  the  in- 
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From  the  date  in  Table  3  it  is  apparent  that  the  members  ot  the 
recorded  sample  distributed  themselves  on  these  aptitudinal-typc  meas¬ 
ures  in  much  the  same  way  as  did  the  total  population 

On  the  basis  of  these  cheeks  (or  selected  variables,  it  can  be 
inierred,  the  recorded  sample  constituted  a  lair  sampling  ot  the  total 
population  ot  submarine  candidates  processed  during  the  pertod. 


1,  Content  Analysis 

The  interview  soundscripts  were  audited  and  studied  for 
content.  A  list  of  verbal  items  and  incidents  occurring  throughout  the 
set  of  interviews  was  compiled.  In  particular,  the  kinds  of  questions 
asked  by  the  interviewers  were  noted.  These  were  subsequently  arranged 
under  summary  headings  for  convenience  in  the  process  of  referral  and 
analysis.  For  example,  the  interviewer  may  have  asked  the  candidate 
how  long  he  had  been  in  the  service  and  why  he  wanted  submarines; 

items  which  seemed  to  be  concerned  with  naval  experience  were  grouped 

and  subsumed  under  the  heading  “Naval  Experience-.  As  the  body  of 
items  were  gathered  it  became  evident  that  the  virtually  unstructured 
nature  of  the  interviews,  and  the  specificity  of  personal  histories  would 
lead  to  an  unwieldy  analysis.  Clearly,  no  single  system  of  substantive 
categories  could  be  devised  to  describe  the  content  of  the  interviews. 
Patently,  the  purpose  of  the  content  analyst  will  govern  the  particular 
scheme  adopted  of  the  many  which  might  be  devised.  Several  considera¬ 
tions,  therefore, suggested  themselves  as  criteria  governing  the  inclusion, 
definition,  and  structure  of  the  units  in  the  analysis  which  would  be  in 
line  with  the  primary  purpose  of  determining  the  degree  of  consistency 
of  interview  content  from  interview  to  interview,  and  from  interviewer 
to  interviewer.  These  criteria  may  be  summarized  as  follows: 

(1)  Generally  Applicable:  The  itemor  incidcntcouldconceivably 


have  occurred  in  all  interviews; 

(2)  Mutually  Exclusive:  The  presence  of  one  item  or  incident 

should  not  depend  on  the  presence  of  any  other  item; 
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(3)  Optimally  Fine:  The  “Bize"  of  the  unit  should  be  of  such 
detail  as  to  render  a  meaningful  comparison  among  interviews  and 
interviewers  by  pointing  up  apparent  differences  in  the  coverage  of 
interview  content,  without  obscuring  apparent  consistencies. 

(4 )  Reliability:  The  unit  should  be  precisely,  yet  broadly,  de¬ 
fined  (as  the  meaning  of  the  unit  refers  to  the  many  ways  of  eliciting  it 
in  different  interviews),  so  as  to  permit  high  reliability  between  coders, 
i.e.,  consistency  of  the  analysis  itself. 

(5)  Comprehensiveness:  The  quantity  of  items  should  be  of 
sufficient  number  to  render  as  complete  and  meaningful  an  analysis  as 
possible. 

(6)  Parallelism:  The  item  should  be  so  “loosely"  defined  as 
to  permit  systematic  comparison  between  interviews.  For  example,  the 
itpm  mother's  attitude  toward  submarine  service  should  be  extended 
to  include  that  of  a  female  figure  who  reared  the  interviewee  and  there¬ 
fore,  may  be  considered  a  “parallel"  or  substitute  for  amother,  to  allow 
for  all  the  shades  of  possibilities  in  personal  histories. 

(7)  Ease:  At  the  same  time,  the  formulation  of  the  body  of 
items  should  admit  of  ease  and  feasibility  in  carrying  out  the  analysis 
during  a  single  playback. 

Thus,  the  items  on  the  instrument  for  content  analyzing  the 
soundscripts  were  formulated  from  those  which  were  observed  to  occur, 
as  opposed  to  a  preconceived  system.  The  instrument  was  thenpre-test- 
ed  on  a  batch  of  recordings  from  which  the  items  had  not  been  derived 
to  check  its  stability,  generality  and  comprehensiveness.  Thepre-test 
clearly  revealed  the  necessity  of  viewing  the  categories  not  simply 
as  questions  asked  by  the  interviewer  of  the  interviewee,  but  as  subject 
matter  elicited  in  the  interview,  by  interviewer  and/or  by  interviewee  . 
That  is,  although  the  unit  may  have  been  derived  originally  from  a  ques¬ 
tion  of  the  interviewer,  c.g.,  “What  do  you  want  to  strike  for  on  thesub- 
marines  ?",  this  content  may  have  been  elicited  spontaneously,  without 
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the  direct  inquiry,  in  response  to  another  question,  viz,  the  reason  for 
his  interest  in  rubmarines,  From  the  standpoint  of  the  objective 
in  this  content  analysis,  spontaneously  offered  content  was  con¬ 
sidered  as  valid  a  coverage  of  content  as  a  directly-elicited  reference, 
and  scored  in  the  appropriate  category.  The  pre-test  showed  sufficient 
stability  in  coverage  and  applicability  of  the  items  in  the  content  analy¬ 
sis  to  render  adequate  the  basic  structure  of  the  instrument,  with  some 
additions  and  revisions.  The  system  was  then  set  aside  for  a  period 
and  reviewed  with  increased  perspective.  Further  refinements  in  line 
with  the  same  criteria  were  suggested. 

Finally,  the  scheme  for  the  content  analysis  was  applied  to  each 
of  the  109  recordings.  Frequency  counts  on  the  extent  to  which  the 
analytic  categories  appeared  in  the  content  of  the  interview  were  con¬ 
verted  to  percentages  of  the  total  sample  and  the  frequencies  for  a  given 
interviewer  were  converted  to  percentages  of  his  sample. 

2.  Time  Analysis 

Originally,  the  process  of  measuring  the  various  speaking 
time  expenditures  during  the  interview  was  governed  by  the  following 
three  considerations: 

(1)  The  thought  that  certain  personality  characteristics  are 
reflected  in  the  amount  of  talking  done  in  such  inter-personal  situations. 
For  example,  it  might  be  supposed  that  the  more  dominant  per  son  might 
do  proportionally  more  talking  than  the  interviewer,  other  things  being 
equal. 

(2)  These  data  might  be  an  indication  of  interviewer  per¬ 
formance.  For  example,  writers  on  interviewing  make  such  statements 
as  "The  good  interviewer  lets  the  interviewee  do  the  talking". 

(3)  These  data  might  facilitate  the  training  of  interviewers 
by  establishing,  perhaps,  an  optimal  time  expenditure  during  the  inter¬ 
view 

These  considerations  notwithstanding,  it  soon  became  apparent 


12 


TgffiKgjga 


"mi  I'liiMt * li*M 


that  time  expenditure  was  also  a  facet  of  the  problem  of  reliability. 
That  is,  how  consistent  were  the  speaking  patterns  of  interviewer  and 
interviewee,  and  also  how  consistently  was  sufficient  total  time  alloted 
in  the  interviews  ? 


Cumulative  stop  watches  were  employed  to  measure  the  time 
spent  in  speaking  by  the  interviewer,  by  the  interviewee  and  the  time 
expended  without  cither  speaking  (designated  hereafter  as  1  dead 
time),  and  the  total  interviewing  time  for  each  interviewer.  All  measures 
of  time  were  based  arbitrarily  from  the  interviewer’s  introduction  of 
himself,  a  formality  which  was  instituted  during  the  study  for  the  pur¬ 
pose  of  identifying  the  recordings.  These  data  were  analyzed  for  each 
interviewer  and  for  the  set  o^  soundscripts  as  a  whole. 

Reliability  of  these  data  was  found  by  correlating  the  obtained 
measures  with  a  re-takc  for  every  fifth  case. 


3.  and  4.  Intra-rater  and  Inter-rater  Consistency 

When  the  project  was  activated,  interview  reports  or  ratings 
of  the  interviewees  were  being  made  solely  in  the  designated  space  of 
the  concise  interview  report  form,  on  which  the  data  on  the  candidate 
from  all  previous  examinations  were  summarized  (See  Appendix  A). 
The  interview  rating  itself  consisted  of  a  simple  decision  of  “Yes"  or 
••No"  to  advance  to  Basic  Submarine  School  and  a  set  of  descriptive 
comments  to  support  the  decision.  The  following  is  an  example  of  a 

“Yes"  decision: 

••An  excellent  man.  Worked  on  submarines  in  Ware  Island 
and  was  impressed  by  caliber  of  submarine  men.  Good 
school  and  job  history.  Wants  to  be  a  career  man.  Broken 
home  by  divorce,  but  seems  to  have  made  a  fine  adjustment. 
No  evidence  of  tension. 


An  example  of  a  “No"  devision: 

“Very  poor  family  background--also  rbcw6  aggressive 
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tendencies.  However,  he  has  a  good  deal  of  drive  and  made 
a  fine  achievement  in  spite  of  educative  and  economic  handi¬ 
caps.  May  be  a  disciplinary  problem.  Also  G.  I.  upset. 

To  determine  the  internal  consistency  of  each  interviewer’s 
judgments  with  those  of  other  interviewers,  the  interview  soundscripts 
were  played  back  during  a  session  in  which  the  inte4vicwcrs  could  ar¬ 
range  to  listen  to  playbacks  of  the  interviews  together.  All  the  informa¬ 
tion  on  the  interview  card,  w'hich  was  available  at  the  time  of  the  origi¬ 
nal  interview,  was  again  made  available  to  the  group  during  the  playbacks. 
The  original  interview  comments  and  the  overall  decision  made  by  the 
interviewer  on  the  report  form  had  been  concealed.  Each  interviewer 
present  was  instructed  to  evaluate  the  interviewee,  or  re-evaluate  the 
interviewee  as  the  case  might  be,  on  the  basis  of  the  playbacks.  The 
former  provided  the  means  for  determining  inter-rater  consistency’,  or 
the  degree  of  correspondence  between  different  interviewers  ’  judgments, 
and  the  latter  provided  the  means  for  determining  intra-rater  consist¬ 
ency,  or  the  degree  of  correspondence  between  the  original  evaluation 
and  the  re-evaluation  of  the  same  cases  by  the  same  interviewer.  Un¬ 
fortunately,  it  was  not  possible  to  regulate  the  interval  between  evalua¬ 
tions  and  re-evaluations;  it  probably  varied  from  one  month  to  four  or 
five  months. 

The  determination  of  the  reliabi  lities  with  respect  to  the  overall 
decision  was  a  simple  matter  of  the  percentages  of  decisions  in  agree¬ 
ment.  However,  clearly,  a  systematic  yardstick  for  dealing  with  the 
unstructured  interview  comments  was  needed.  In  the  service  of  isolat¬ 
ing  the  relcvent  traits,  a  rating  form  had  been  developed  out  of  the  com¬ 
ments  made  on  the  109  interviewees  of  the  recorded  sample  and  also  on 
an  additional  sample  of  573  interviewees  from  the  unrecorded  group. 
The  principal  traitj  which  were  apparently  being  evaluated  unstructured- 
ly  were  included  thereon  and  certain  illustrative  types  of  evidences, 
both  favorable  and  unfavorable,  which  may  have  entered  into  the  evalua- 


tion  of  each  trail  were  enumerated  under  each  trait.  The  first  inter¬ 
view  report  form,  as  it  was  constructed  at  that  time  and  put  into  use  is 
exhibited  as  Appendix  B,  and  further  elaboration  of  its  development  is 
given  under  D,  Isolation  of  relevant  traits  in  this  section. 

The  matter  of  determining  the  intra-rater  and  inter-rater  re¬ 
liabilities  of  these  comments  was  then  thought  to  be  most  meaningfully 
done  against  the  backdrop  of  the  first  interview  form.  The  unstructur¬ 
ed  interview  comments  on  the  109  interviewees  in  the  soundscript 
sample,  and  their  re-evaluations  by  the  same  interviewer,  as  well  as 
their  evaluations  by  other  Medical  Officer  interviewers  were  “structur¬ 
ed”  on  this  first  interview  report  form.  The  determination  of  the  relia¬ 
bilities  then  became  a  matter  of  obtaining  for  each  trait  on  the  inter¬ 
view  report  form,  the  percentages  of  agreement  in  rating  positions  on 
the  four-point  scale,  between  each  pair  of  interviewers  and  between  the 
pairs  of  evaluations  by  the  original  interviewer  himself  of  the  same 

candidate. 


5.  Aids  to  the  Interview 


Tw  o  instruments  were  in  use  as  aids  to  the  interview.  One  was 

a  personal  history  inventory  called  “The  Confidential  Questionnaire “, 
the  other.  “The  Submariner  Stereotype”  represented  the  application 
of  a  special  measurement  technique  involving  the  double  administration 
of  a  set  of  words  or  phrases,  once  in  the  frame  of  reference  of  the  re¬ 
spondent's  own  self-picture,  and  second,  in  the  frame  of  reference  of 
the  submariner.  Detailed  accounts  of  the  study  of  these  two  instruments, 
including  findings  on  reliability  and  validity,  were  prepared  under  sepa¬ 
rate  cover:  “The  Interview;  II.  Aids  to  the  Interview  -  The  Confiden¬ 
tial  Questionnaire",  and  “The  Interview:  III.  Aids  to  the  Interview  - 
The  Submariner  Stereotype." 


C.  Validity 

pas s-fail  data  were  obtained  from  the  Basic  Submarine  School 
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for  the  682  submarine  candidates  in  the  total  "population”  pass¬ 
ing  through  the  Laboratory  during  the  period  of  15  March  1951  to  15 
July  1951.  The  pass-fail  data  were  computed  for  the  predictive  efficiency 
of  each  interviewer  and  for  the  group  of  interviewers  as  a  whole.  Be¬ 
cause  candidates  are  sometimes  identified  as  borderline  cases  by  the 
interviewers,  a  supplementary  analysis  was  made  of  the  performance  of 
this  group. 


2.  and  3.  Prediction  of  success  in  submarines  and  the  relation¬ 
ship  of  the  interview  to  other  predictors. 


It  will  be  noted  thatitwasnotpossibletoexplorcthequestions 
of  ultimate  validity  and  the  relationship  of  the  interview  to  other  pre¬ 
dictors,  due  to  the  lack  of  time  and  the  lack  of  criterion  data, 

4.  Aids  to  the  Interview 

The  two  aids  to  the  interview,  the  Confidential  Questionnaire 
and  the  Submariner  Stereotype,  were  also  tested  for  their  power  to  dif¬ 
ferentiate  the  successful  candidates  from  those  who  were  unsuccessful  in 
the  Basic  Submarine  School.  Validation  involved  the  identification  of 
three  groups  of  unsuccessful  cases- -academically  disqualified,  tempera¬ 
mentally  disqualified,  and  physically  disqualified,  and  the  comparison  of 
the  data  for  each  of  the  three  disqualified  groups  with  those  of  the 
successful  group.  The  exact  procedures  are  reported  in  detail  in  the 
two  reports  previously  cited. 

D.  Isolation  of  relevant  traits 

The  comments  of  interviewers  on  both  the  recorded  and  unrecord¬ 
ed  samples  were  examined  for  identification  of  the  principal  traits  which 
were  being  rated  in  an  unstructured  manner .  Those  which  recurred  were 
identified  principally  as  five:  Personal  Adjustment,  Adjustment  to  Navy 
Life,  Motivation,  Interest  in  Submarines,  and  Aptitude  for  Submarines. 
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Illustrative  evidence  cited  in  the  interviewers  comment*,  both  favor¬ 
able  and  unfavorable,  which  may  have  exemplified  the  presence  and 
quantity  of  each  trait,  were  gathered  end  listed  for  each  of  these  traits 
inside  of  the  form. 

The  use  of  this  report  form  during  a  period  of  three  to  four 
months  showed  a  need  for  revision.  Comments  made  in  the  space  pro¬ 
vided  for  ‘'additional  comments"  were  incorporated  as  evidences  and  a 
middle  category  for  the  evidences  was  added.  This  first  revision  of  the 
interview  report  form  is  exhibited  as  Appendix  C. 

RESULTS 

The  findings  for  each  major  area  of  the  investigation  will  be 
discussed  in  the  same  manner  of  organization  under  their  respective 
headings. 

A.  Background  Survey  of  the  Literature 

The  ge  neral  survey  of  the  literature  on  the  interview  reveals  that 
the  following  statements  are  documented: 

(1)  The  interview  continues  to  be  popular  as  a  screening  and  se¬ 
lection  technique  despite  some  negative  evidence  pointing  to  its  very 
small  contribution  in  well-rounded  selection  programs  using  other  tools 
and  techniques; 

(2)  The  value  of  the  interview  is  believed  to  lie  in  such 
evaluative  matters  as  the  gathering  of  a  life  history,  and  the  unique 
opportunity  to  organize  facts  from  various  sources,  and  in  such  non- 
evaluative  functions  as  establishing  friendly  relations,  according  person¬ 
al  treatment,  and  giving  information;  ** 

(3)  The  reliability  and  validity  of  the  interview  are  highly 
specific  to  a  given  situation,  due  to  such  factors  as  the  specificity  of 
interviewer  skills  in  both  intervicw-ing  and  evaluating  and  the  specificity 
of  interpersonal  relationships,  the  specificity  of  purposes  for  the  inter- 


viewing,  and  the  like. 


(4)  The  reliability  and  validity  of  the  interview  are  a  function  of 
the  following  variables: 

(a)  The  interviewers’  training; 

(b)  The  interviewers*  knowledge  of  job  specifications; 

(c)  Theinterviewcrs*  agreement  on  criteria  of  evaluation; 

(d)  The  amount,  reliability  and  validity  of  antecedently 
collected  objective  data  available  to  the  interviewer ; 

(e)  The  conduct  of  the  interview  in  a  semi-structurrd 
manner  which  has  been  agreed  upon  by  the  inter¬ 
viewers; 

(f)  The  inclusion  of  traits  for  assessment  in  the  inter¬ 
view  which  have  been  demonstrated  to  be  related 

.  to  success  in  the  activity; 

(g)  The  judgment  of  traits  in  terms  of  their  manifesta¬ 
tions  as  characteristics  of  specified  groups,  rather 
than  as  abstractly  conceived  phychological  qualities. 

(h)  The  availability  of  adequate  criteria  against  which  to 
evaluate  the  predictive  efficiency  of  the  interview; 

{i )  The  degree  of  restriction  in  the  range  of  applicants 
on  the  traits  to  be  rated; 

(5)  Such  traits  as  the  follow  ing  arc  thought  to  be  ratable  in  a  pat¬ 
terned  interview,  and  to  be  largely  unmeasurable  by  other  means:  en¬ 
ergy,  social  adjustment,  emotional  control,  and  conscience. 

Y/ith  regard  to  the  findings  on  the  interview  in  the  Armed  Forces, 
these  are  observe.,’  to  differ  fj r  the  different  branches  of  the  service. 
This  is  in  line  wii-b  the  specificity  of  interview  validity,  in  general,  and 
also  the  related  factors  of  the  different  types  of  interviews  conducted 
throughout  the  military--induction,  classification,  neuro-psychiatric, 
and  the  like--on  different  groups  of  different  sizes. 

Inasmuch  as  fairly  d-tailed  abstracts  of  the  studies  arc  included 
in  the  initial  report  of  this  series,  “The  Interview  I.  A  Selectively 
Abstracted  Bibliography”,  only  the  conclusions  reached  for  each  branch 
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of  the  service  will  be  summarized  here.  The  footnotes  will  provide  the 
reader  with  the  exact  source  of  the  study  preceded  parenthetically  by 
the  entry  number  to  the  abstract  of  this  source  in  the  abstracted  biblio¬ 
graphy. 

In  the  Army  the  brief  clinical  interview  in  induction  screening 
was  found  to  be  effective  in  predicting  adjustment  to  the  Army,  and  the 
findings  indicated  to  the  investigator  that  in  the  case  of  “doubtfuls  ,  a 
chance  should  be  taken. * 

Also,  while  very  brief  psychiatric  examinations  detected  un- 
suitables  among  enlisted  personnel,  a  longer  psychiatric  examination 
detected  more  unsuitables }  Further,  brief  psychiatric  interviews  on 
replacements  to  rifle  companies  predicted  combat  effectiveness  with  a 
moderate  degree  of  success,3 

In  the  Army  Air  Forces,  on  the  other  hand,  studies  of  the  inter¬ 
view  in  the  selection  of  aircraft  pilot  have  led  to  the  conclusions  that 
the  clinical  interview  adds  little  to  a  testing  program4 5, and  identifies 
only  the  most  serious  disorders^. 

*(3)  Aita,  J.A.  Efficacy  of  the  brief  clinical  interview  method  inpredict- 
ing  adjustment,  Arch.  Neurol.  Psychiat.,  1949,  6^,  170-176. 

2(67)  Hadley,  E.E.  ct  al  -  An  experiment  in  military  selection.  Psychi¬ 
atry,  1942,  5,  371-402. 

3(65)  Glass,  A.J.  An  attempt  to  predict  probable  combat  effectiveness 
by  brief  psychiatric  examination.  Amcr .  J .  Psychiat.,  1949,  106.  81-90. 

4  (4 3)  Dunlap,  J.W,  arid  Wantman,  M.J.  An  investigation  of  the  interview 
as  a  technique  for  selecting  aircraft  pilots.  CAA  Airman  Development 
Div.  Report  No.  13,  Washington  D.C.,  Aug.  1944,  Pp  63. 

i 

5(78c)  Gillespie,  R.D.  and  Reid,  D.  D.  Prediction  of  failure  in  flying 
training  and  in  operations  by  the  brief  psychiatric  interview.  FPKC  No. 
b4  1 ,  September  1940. 
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In  the  Navy,  neuropsychiatric  examination  and  psychometric 
examination  of  recruits  were  both  reported  to  predict  about  the  same 
percentages  of  eventual  training  station  discharges,  but  the  tests  pro¬ 
duced  more  ‘false  positives',  i.e.,  individuals  who  arc  screened  out 
by  the  test  but  who  are  found  to  be  capable  of  service. 

In  connection  with  the  selection  of  reserve  cadets  in  the  Coast 
Guard,  the  reliability  of  the  interview  is  found  to  be  greatest  as  shown 
by  a  large  number  of  perfect  agreements ,  in  the  case  of  the  lowest  inter¬ 
view  ratings.2  When  the  general  effectiveness  of  the  selection  program 
is  explored  against  a  criterion  of  success  in  a  training  program,  it  is 
found  that  ability  tes-ts  of  numerical,  verbal  and  spatial  abilities  and  the 

personal  interview  were  almost  equally  efficient  predictors,  but  the 

3 

combination  was  superior  to  either  alone  . 

In  the  Marines,  the  validity  of  the  interview  was  estimated  by 
efficiency  in  picking  men  able  to  survive  the  eight-week  training  per iod. 
By  means  of  the  interview,  most  of  the  unfit  were  identified  and  only 
22  per  cent  of  the  unfit  were  missed  . 

l(148)  Wittson,  C.L.  and  Hunt,  W.A.  Three  years  of  naval  selection: 
A  retrospect.  War  Med.,  1945, _7_,  218-221. 

2(101)  Newman,  H.,  Bobbitt,  J.M.  and  Cameron,  D.C.  The  reliability  of 
the  intervie’w  method  in  an  officer  candidate  evaluation  program.  Amcr. 
Psychologist,  1946,  J^,  103-109. 

3(49)  Felix,  R.H.  et  cl.  An  integrated  medico-psychological  programat 
the  U.3. Coast  Guard  Academy,  preliminary  report.  Am.  J.  Psychiat., 
1945.  101,  635-642. 

4(95)  Miles,  D.W.  et  al.  The  efficiency  of  a  high  specj  screening  pro¬ 
cedure  i:.  detecting  the  ncuropsychiatrically  unfit  at  a  U.S. Marine 
Corps  Recruit  Training  Depot.  J.  Psychol.,  1946,  2^,  243-268. 
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While  It  might  perhaps  be  considered  fitting  to  delve  into  these 
studies  for  their  strengths  and  limitations  in  order  to  qualify  the  find¬ 
ings,  as  expressed  above  without  interpretation,  it  does  not  seem  appro¬ 
priate  to  the  Investigators  to  cite  these  here.  Admittedly,  the  study  of 
the  interview  in  a  scientific  manner  is  an  exceedingly  difficult  task,  al¬ 
though  none  the  less  challenging  because  of  this.  The  methodology  in¬ 
volved  in  the  study  of  the  interview  in  its  natural  setting  is  difficult  to 
exercise  and  the  investigator  is  confronted  with  the  problem  of  the 
adequacy  of  the  available  criteria  against  which  to  validate  the  interview. 
It  is  recognized  that  it  is  highly  problematical  in  such  studies  as  are 
made  of  the  interview,  whether  the  factors,  which  lend  reliability  and 
validity,  as  enumerated  previously,  were  observed  or  indeed,  were 
observable.  It  seems  that  in  the  military,  as  well  as  in  industry,  truly 
adequate  studies  of  the  reliability  and  validity  of  the  interview  have 
not  been  made. 

Rather  it  might  be  well  to  dwell  on  a  thought  which  had  parti¬ 
cular  pertinence  to  the  present  investigation.  There  is  observed  a 
trend  in  the  literature,  especially  with  regard  to  the  military ,  of  present¬ 
ing  the  findings  on  the  interview  in  terms  cf  comparative  predictive  values 
with  test  measures  of  both  aptitudinal  and  personality  types.  However, 
if  the  interview  represents  the  point  at  which  all  data  on  interviewees 
are  expected  to  be  properly  synthesized,  as  in  the  case  in  the  submarine 
service,  it  becomes  highly  problematical  to  conceive  of  findings  on  the 
interview  '‘alone”.  As  enumerated  previously,  the  findings  on  the 
interview  arc  a  function  of  variables  both  antecedent  and  subsequent  to 
the  interview  as  well  as  inherent  to  the  interview  situation.  Investiga¬ 
tion  of  the  interview  therefore  demands  a  very  comprehensive  research 
design  to  encompass  these  variables.  The  difficulty  in  the  phrase  "the 
interview  'alone',”  notw  ithstanding,  a  relatively  unique  evaluative  func¬ 
tion  to  the  interview  need  not  be  denied.  It  would  appear  that  the  inter¬ 
view  can  be  directed  to  the  prediction  of  some  elements  which  are  requir¬ 
ed  for  success  in  a  given  activity,  which  are  relatively  independent  of 
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what  other  instruments  measure,  and  which  are  largely  unmeasurable  by 
other  measures.  These  elements  might  be  factor  s  inpersonal  and  social 
adjustment,  if  these  have  been  demonstrated  to  be  related  to  success .  Con¬ 
versely,  estimates  of  aptitude,  such  us  are  made  in  the  interview 
by  means  of  the  proper  synthesis  of  obtained  measures,  can  be  made 
relatively  independently  of  other  traits  requiredfor  success,  i.e.  personal 
and  social  adjustment  traits.  Thus,  the  interviewer  may  appropriately 
judge  and  weigh  these  dual  factors  of  aptitude  and  personal  and  social 
adjustment,  if  they  are  both  demonstrated  to  be  related  to  success  in  a 

given  activity,  and  he  may  synthesize  the  result  in  his  overall  evaluation. 

• 

Such  considerations  as  these  entered  into  the  development  of  the 
two  interview  report  forms  which  were  put  into  esc  during  the  present 
investigation,  and  which  are  exhibited  as  Appendixes  B  and  C.  It  will 
be  observed  that  the  interviewer  evaluated  "Aptitude  for  Submarine 
Service"  and  factors  in  personal  and  social  adjustment.  Such  evidences 
as  GCT  and  Mechanical  Test  were  cited  as  evidences  to  support  the 
judgments  of  aptitude,  while  the  remainder  of  the  form  taps  areas 
previously  unevaluated. 

B.  Reliability  of  the  Interview 

1.  Interview  Content 

The  findings  on  the  application  of  the  scheme  devised  for  con¬ 
tent  analyzing  the  109  collected  interview  soundscrips  arc  set  forth  in 
Appendix  D,  Tablel.  The  results  are  indicated  there  for  the  total 
group  of  soundscripts,  as  well  as  separately  for  each  participant  inter¬ 
viewer.  Unfortunately,  time  limitations  did  not  permit  the  estimation  of 
the  reliability  of  these  data,  i.e.,  consistency  of  the  content  analyzer. 
However,  the  investigator  who  developed  the  scheme  from  auditing  of 
the  soundscripts  also  applied  the  scheme  to  the  soundscripts;  this  factor , 
coupled  with  the  generally  high  reliability  for  simple  present-absent 
type  content  analyzing,  would  lend  support  to  the  estimate  that  the  reli¬ 
ability  or  consistency  of  the  findings  would  be  sufficiently  high  to  trust 
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the  present  results  ns  summarized. 

From  these  summary  data  in  Appendix  D,  Table  1,  Table  4  has 
been  derived  and  shows  the  relative  degree  of  consistency  in  the  cover¬ 
age  of  the  existent  subject  matter  during  the  period  15  March  1951  to 
15  July  1951. 

From  the  data  in  Table  4,  it  can  be  seen  that  the  items  which 
attained  the  greatest  degree  of  consistency  in  coverage  throughout  the 
109  interviews  are  the  following,  in  order  of  descending  reliability: 

Degree  of 
Consistency 


Item  in  per  cent 


1.  Establishment  of  attendance  at  high  school 

or  college  -  --  --  --  --  --  --  --  --  -  86 

2.  Reason  for  interest  in  submarines  -  --  --  --  --  --  -  83 

3.  Whether  the  candidate  had  any  brothers  or 

sisters  - - -  81 

4.  Marital  status  - -  -  -  - - -  —  -  -  75 

5.  Establishment  of  whether  candidate’s  parents 

were  living,  dead,  or  separated  -  --  --  --  70 

6.  Reason  for  leaving  school  -  graduated,  join 

the  Navy,  etc.-  - -  64 

7.  Position(s),  job(s)  or  occupations )  held  pre- 

or  post-graduation  -  --  --  --  --  —  -  -  -  56 

8.  Kinds  of  duty  held  in  Navy  -  --  --  --  --  --  --  --  --  55 

9.  Relative  position  in  the  family  amongst 

siblings  or  only  child-  -  - - - - - - 54 

10.  Placc(s)  of  duty  in  the  Navy  -  -  -  - - - - —  50 

11.  Length  of  service — - —  - - -  -  —  -  50 


It  is  observed  that  the  items  of  greatest  consistency  in  coverage 
are  primarily  of  the  factual,  biographical  type.  From  the  remaining 
data  in  Table  4,  it  is  observed  that  the  items  of  lowest  consistency  are 
abundantly  of  the  attitudinal  type. 

These  findings  suggest  the  interpretation  that  the  interviewers 
were  pursuing  factual  information  without  sufficient  subsequent  probing 
into  attitudes,  which  may  prove  to  be  important  in  assessment.  In  their 
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T»ble  4.-  The  relative  degree  of  consistency  In  the  coverage  of  eadstanf 
subject  matter  throughout  109  Interview*  with  candidate*  for 
the  submarine  service  during  the  period  15  March  1951  to  15 
July  1951. 


4 
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defense,  occurs  the  possibility  that  the  factual-type  items  can  be  viewed 
as  necessary  for  the  building  and  establishment  of  rapport.  As  only  a 
rough  support  to  the  guess  that  this  was  not  likely  in  this  instance,  data 
were  gathered  which  noted  the  pattern  of  opening  remarks  made  by  each 
interviewer.  It  was  impossible  to  carry  the  analysis  any  further  along 
in  the  interview  due  to  the  extremely  unstructured  nature  of  these  inter¬ 
views  at  the  time. 

In  Table  5  are  summarized  the  frequencies  and  percentages  of 
the  total  number  of  interviews  which  were  opened  by  the  given  opening 
inquiries.  Comparative  percentages  are  also  given  of  the  degree  to 
which  each  opening  remark  was  elicited  as  content. 


Table  5.-  Frequencies  and  percentages  of  the  total  number  of  inter¬ 
views  which  used  given  opening  remarks  and  the  compara¬ 
tive  percentages  of  the  degree  to  which  each  was  elicited 
as  content  throughout  the  109  interviews 


Item 


Length  of  service 

Reason  for  interest  in  subs 

Home  town 

Places  of  duty 

Kinds  of  duty 

Time  of  interest  in  subs 

High  school  or  college 

Reason  for  entry  into  Navy 

Birthplace 

Any  special  physical  eompli 
Rate 

General  health 

Headaches 

Nationality 

Marital  Status 

Reason  for  leaving  school 

Academic  standing 


:currcncc 

requency 

as  opening 
Percentage 

Occurrence  as 
Content  Percentae 

39 

36 

50 

17 

16 

83 

14 

13 

34 

9 

6 

50 

8 

7 

55 

6 

6 

34 

2 

2 

86 

2 

2 

43 

2 

2 

9 

nts2 

2 

12 

2 

■> 

23 

1 

1 

17 

1 

1 

5 

1 

1 

4 

1 

1 

75 

1 

1 

64 

1 

1 

25 

*  From  the  content  analysis  data  in  Appendix  D  -  Table  1. 
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Comparison  of  the  entries  in  the  two  percentage  columns  in  Table  5 
shows  a  very  small  proportion  of  the  coverage  of  the  factual-type  itemB 
may  be  said  to  represent  with  some  justification,  perhaps,  the  rapport 
building  objective.  Further  evidence,  however,  serving  to  decrease  the 
justification  is  given  in  the  observation  that  these  questions  were  not 
leads  to  greater  probing  in  related  areas  as  reflected  by  the  low  percent¬ 
ages  of  occurrence  on  the  attitudinal  type  questions  related  to  them. 

These  frequently  mentioned  items  arc,  therefore,  rightly  re¬ 
garded  as  genuine  informaticn--eliciting.  It  is  noted  that,  of  the  11 
items  abstracted  earlier  from  Table  4,  only  six  (starred)  may  not 
have  been  derived  from  the  other  data  available  to  the  interview  er  from 
the  interview'  report  card  or  the  Confidential  Ouestionnaire.  Yet,  in 
another  sense,  even  this  may  be  defensible  under  some  circumstances 
where  attitudes  may  be  reflected  in  the  manner  of  response  to  such 
straight-forward  questions.  However,  considering  the  pressure  of  the 
time  available  for  the  interviews  with  the  candidates  for  the  submarine 
service,  and  therefore,  what  the  optimal  time  expenditure  might  be  for 
obtaining  various  kinds  of  information,  it  appears  unlikely  that  attitudes 
reflected  in  the  manner  of  response  to  such  factual  questions  would 
prove  diagnostic  without  the  further  probing  indicated. 

On  the  positive  side,  a  genuine  and  consistent  attempt  is  made  to 
assess  each  candidatc’6  motivation  for  submarine  service.  To  a  much 
lesser  extent,  is  some  attempt  made  to  assess  their  adjustment  to  Navy 
life.  Certainly,  however,  some  of  the  less  frequently  occurring  items 
in  these  connections  are  potentially  of  sufficient  importance  to  the  sub¬ 
marine  service  as  to  be  used  with  much  greater  consistency,  i.e, 
qualities  of  a  submariner,  qualities  the  individual  has  to  offer  submarines, 
and  the  like. 
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2.  Time  Analysis 

The  measurement  of  relative  proportions  of  interviewer 
speaking  time,  interviewee  speaking  time,  “dead",  and  total  interview¬ 
ing  time,  yielded  an  analysis  of  these  indices  for  the  total  group  of  109 
boundscripts  as  well  as  for  each  interviewer.  These  data  are  summari¬ 
zed  in  Table  6  on  page  28. 

With  regard  to  the  reliability  of  these  data,  the  correlation  be¬ 
tween  the  measures  obtained  on  the  original  take  (on  which  the  summary 
is  based)  and  the  re-take  for  every  fifth  case  is  as  follows  for  each  index: 

Interviewer  Speaking  Time  .9912 
Interviewee  Speaking  Time  .9983 
Total  Time  .9986 

Clearly,  the  method  of  measuring  these  speaking  times  proved  to  be 
highly  reliable. 

In  view  of  the  reliability  of  the  data  in  Table  6,  therefore,  there 
is  considerable  variation  in  the  speaking  patterns  of  conducting  the 
interview  among  the  six  interviewers.  Interpretively  the  following 
statements  appear  descriptive  for  each  interviewer: 

Interviewer  A:  Spoke  for  about  the  average  proportion  of  interviewer 
speaking  time;  his  interviewees  also  spoke  in  average  proportions;  there 
was  average  “dead"  time  in  his  interviews;  finally, aver  age  total  inter¬ 
viewing  time  was  less  than  average  and  lowest  of  the  interviewers. 
Interviewer  B:  Spoke  least;  there  was  average  interviewee  speaking 
time;  most  “dead"  time  of  all  interviews;  total  interviewing  time  was 
close  to  average. 

Interviewer  C:  Speaking  time  more  than  average;  less  than  average 
“dead"  time;  interviews  were  longer  than  average,  but  also  the  most 
variable. 

Interviewer  D:  Spoke  blightly  more  than  average;  average  interviewee 
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Table  6.-  Average  total  interviewing  time  and  the  average  relative  proportio 
of  interviewer  and  interviewee  speaking  time,  the  ratio  of  intervie 
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*  “Dead**  time  is  time  expended  without  either  interviewer  or  interviewee  speaking.  It 
is  understood  that  this  time  was  probably  spent  in  scanning  the  record  of  the  candidate, 
preparing  for  inquiries,  etc. 
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speaking  time;  and  average  “dead"1  time.  Pattern  of  conduct  on  these 
measures  most  closely  resembles  that  of  the  average  of  the  whole  set 
of  interviews. 

Interviewer  F:  Spokeless  than  average  and  there  was  almost  as  much 
“dead"  time;  greatest  interviewee  speaking  time;  average  total  inter¬ 
viewing  time  was  the  greatest. 

Interviewer  F:  Spoke  most  on  the  average  with  least  interviewee 
speaking  time,  less  than  average  ''dead"  time  and  above  average  total 
interviewing  time. 

As  a  corollary  to  the  above  interviewer  descriptions ,  on  an  over¬ 
all  basis,  it  is  noted  that  the  shorter  interviews  expended  the  greater 
“dead"  times.  While  the  shorter  interviews  are  characterized  by 
average  interviewee  speaking  times,  they  are  also  characterized  by 
both  above  and  below  average  interviewer  speaking  time. 

Apparently,  therefore,  the  shorter  interviews  fail  to  meet  two 
desirable  features  of  interviewing,  namely,  efficient  use  of  the  available 
time  and  having  the  interviewee  do  the  talking. 

The  averages  of  the  ratios  of  interviewer  speaking  time  to  inter¬ 
viewee  speaking  time  for  each  interviewer  shows  considerable  varia¬ 
bility  from  interview  to  interview.  This  is  not  at  all  unusual  if  the  place 
of  th:s  variable,  i.e.,  verbosity,  among  individual  differences  is  kept  in 
mind.  However,  it  is  noted  that  four  out  of  the  six  interviewers,  on  the 
average  spoke  more  than  half  as  much  as  the  interviewee.  While  there 
docs  not  si  cm  to  be  any  agreed-upon  optimal  figures  for  such  a  measure, 
it  is  very  doubtful  that  such  high  ratios  arc  desirable,  if  the  aim  of  the 
interview  is  to  assess  the  interviewee.  Indeed,  the  interviewers  could 
probably  profit  by  letting  the  interviewee  do  more  of  the  talking,  and 
permitting  less  “dead"  time. 
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3.  Intra-rater  consistency 

The  findings  on  the  application  of  the  method  for  determin¬ 
ing  the  intra-rater  consistency,  i.e.,  consistency  of  the  individual  inter¬ 
viewer’s  judgment,  is  set  forth  in  Table  7. 

Table  7.-  Percentage  agreement  between  evaluation  and  re-evaluation 


of  cases  by  the  same  interviewer  for  overall  decision,  and 
for  five  trait  ratings _ 


Number 

%  Agreement 

'  _  . . 

Interviewer 

Re-eval- 

in  Overall 

Pers. 

Adj. 

Moti- 

Int 

Apt 

Code 

uated 

Decision 

Adj. 

Navy 

vntion 

Subs 

Subs 

A  4*3 

18 

94 

94 

100 

89 

94 

100  Excl.N 

89 

89 

44 

72 

62  Incl.N. 

B  21 

5 

100 

80 

100 

60 

100 

100 

60 

60 

60 

100 

100 

C  20 

19 

89 

84 

100 

74 

95 

89 

84 

84 

32 

58 

58 

D  15 

2 

100 

100 

50 

50 

50 

100 

Total  99 

44 

93 

89 

100 

80 

95 

95 

84 

82 

41 

68 

57 

Examination  of  the  dat_  ...  Table  7  shows,  first,  that  only  40  per 

cent  of  the  cases  in  the  soundscript  sample  were  re-evaluated  by  the 

original  interviewers  by  means  of  “play-backs”.  This  limited  number 

was  due  to  the  uncontrollable  factor  of  the  transfer  of  all  the  interview - 

ers  except  interviewer  C  who  was  able  to  re-evaluate  almost  all  of  his 

interviews.  On  the  basis  of  the  40  per  cent  re-evaluation,  it  is  observed 

*  The  percentages  on  the  first  line  of  these  data  are  based  on  absolute 
agreements  in  the  trait  ratings  excluding  the  instances  where  no  re¬ 
sponse  was  made  to  the  trait  on  either  the  original  or  re-evaluation, 
but  includes  the  instances  where  no  response  was  made  on  both  as  an 
“agreement”. 

**The  percentages  on  the  second  line  of  these  data  ore  based  on  the 
absolute  agreements  in  the  trait  ratings,  including  the  instances  where 
no-response  was  made  on  both  as  on  “ogreement”,  and  including  the 
instances  of  no-response  on  either  the  original  evaluation  or  re-evalua¬ 
tion  as  an  “inconsistency  ”.  These  pei -.entages  arc  viewed  as  much  more 
reflective  of  the  concept  of  reliability  than  the  former  ones. 
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that  on  the  average  93  per  cent  of  the  overall  decisions  were  in  agree¬ 
ment.  However,  it  should  be  noted  here  that  only  a  very  small  percent¬ 
age  of  those  interviewed  arc  rejected,  5  per  cent  .  Since  the  selection 
ratio  is  quite  high,  then  in  general  this  degree  of  reliability  is  neither 
surprising  ncr  any  too  high. 

Directing  attention  to  the  three  changes  in  overall  decision,  it 
is  found  that  two  of  the  three  changes  were  from  ‘‘No’'  to  “Yes”,  while 
only  one  was  from  “Yes"  to  “No”. 

As  for  the  individual  trait  ratings  which  were  structured  by  one 
of  the  investigators  along  a  four-point  scale,  considerable  variation  is 
indicated.  Fairly  high  reliabilities  (from  60-100  per  cent  consistency 
for  the  group  as  a  whole)  arc  indicated  for  individual  trait  ratings. 
It  should  be  pointed  out  that  this  excludes  the  instances  in  which  no  indica¬ 
tion  of  the  trait  judgment  was  made,  either  on  the  original  evaluationor 
re-evaluation,  but  includes  the  instances  where  no  mention  was  made  on 
both,  because  the  latter  was  considered  a  "consistency”.  When  the  in¬ 
stances  of  no  mention  arc  taken  into  account,  however,  the  reliabilities 
drop  into  the  range  of  from  4  1  to  64  per  cent.  The  latter  ranges  are 

viewed  as  more  reflective  of  the  reliability  concept  than  the  former 

ones . 

Parenthetically,  it  is  of  interest  to  note  that,  of  the  total  number 
of  inconsistencies  oi  the  no- response  type,  56,  35  were  in  the  direction 
of  no-response  on  the  evaluation  to  some  indication  made  on  the  re- 

evaluation;  and  only  21  were  rated  on  the  evaluation  but  not  on  the  re- 

evaluation,  Incid- ntalJy  .this  trend  was  observed  to  be  most  pronounced 
for  the  trait,  Aptitude  for  Submarines;  in  other  words,  the  low  reliability 
of  57  per  cent  for  this  trait,  seems  to  consist  mainly  in  the  failure  to 
report  on  Aptitude  for  Submarines  in  the  original  evaluation,  but  a  tend¬ 
ency  to  report  and,  therefore,  attend  more  heavily  to  aptitudinal  factors 
in  the  re-evaluation  situation.  This  may  be  a  result  of  the  “play-back” 
*  From  the  validity  data  in  Table  9. 
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situation  where  the  person  being  evaluated  is  absent  and  the  interview¬ 
er  is  left  merely  with  the  voices  of  the  original  interview  situation. 

Several  noteworthy  problems  attached  to  the  concept  of  relia¬ 
bility  of  the  interview  are  reflected  here.  To  recapitulate  the  observa¬ 
tion,  it  appears  that  the  interviewer ,  having  rated  the  traits  in  the 
original  instance,  tended  to  re-observe  and  re-evaluate  them.  In  retro¬ 
spect,  however,  he  was  able  to  observe  and  rate  some  of  the  traits  orig¬ 
inally  unobserved  and/or  not  rated. 

In  one  sense,  this  trend  may  be  indicative  of  the  training  value 
which  was  derived  from  listening  to  the  play-backs  as  well  as  from  the 
ongoing  research  program.  However,  it  also  raises  important  theoreti¬ 
cal  questions  concerning  the  intra-rater  reliability  of  the  interview. 
Is  an  interviewer  likely  to  be  able  to  observe,  to  perceive,  and  therefore, 
to  rate  more  in  a  re-evaluation  situation  than  in  the  original  evaluation 
situation?  While  this  trend  was  found  using  the  play-back  research 
design,  it  is  quite  possible  that  this  trend  would  inhere  in  the  much 
more  preferable  research  design,  if  it  were  administratively  feasible ,  of 
having  the  same  interviewer  rc-intcrvicw  the  same  candidate  and  re¬ 
evaluate  him.  This  problem  is  even  more  provocative,  when  it  is  re¬ 
membered  that  if  the  more  conventional  prescribed  and/or  structured 
rating  form  is  used  in  any  reliability  research  design  of  the  intervw  w, 
this  perceptual  problem  is  not  likely  to  be  reflected  in  the  data.  In  both 
instances  of  evaluation  and  rc-cvaluation,  a  report  is  made  when  the 
trait  is  suggested  or:  the  form.  Reliability,  then  is  reflected  for  reports 
made  at  the  dictates  of  the  form,  rather  than  reports  made  at  the  dictates 
of  the  situation. 

4.  Inter-rater  consistency 

The  findings  on  the  application  of  the  method  for  determining 
inter-rater  consistency,  i.e.  the  consistency  of  the  judgments  of  each 
interviewer  with  those  of  the  other  interviewers,  are  presented  below 
in  Table  8.  It  will  be  observed  that  three  newly  assigned  Medical 


Officer  interviewers,  besides  those  involved  in  the  original  set  of  109 
soundscript6,  evaluated  some  of  the  recordings  of  the  original  inter¬ 
viewers,  This  was  done  as  part  of  their  initial  training  program. 
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Table  8.-  Percentages  of  agreement  between  ihe  evaluations  of  cases  by 
the  original  interviewer  and  the  evaluations  of  the  same  cases 
by  other  interviewers  for  the  overall  decision  and  for  five 


trait  ratings. 


Interviewers 
Code  N 

Number 

Rc-cval. 

Overall 

Decision 

Pers. 

Adj. 

Adj. 

Navy 

Motiva¬ 

tion 

Ini. in 
Subs 

Apt.tor 

Subs 

A 

77 

100 

67 

100 

100 

Excl. 

and  B 

43 

9 

89 

77 

67 

44 

44 

44 

Incl. 

and  C 

38 

100 

79 

76 

74 

89 

100 

71 

71 

•  29 

55 

42 

and  D 

4 

100 

100 

100 

75 

100 

100 

75 

75 

25 

75 

75 

and  G 

15 

100 

93 

93 

80 

100 

100 

Excl.l 

13 

67 

27 

67 

47 

Incl.h 

and  H 

10 

100 

80 

100 

90 

100 

100 

60 

60 

30 

60 

80 

and  I 

7 

100 

100 

100 

100 

100 

100 

29 

29 

29 

71 

43 

B 

21 

100 

67 

100 

67 

100 

100 

and  A 

3 

67 

67 

0 

33 

33 

and  C 

9 

100 

56 

100 

89 

100 

78 

56 

56 

33 

56 

44 

C 

20 

6 

100 

100 

100 

100 

100 

100 

and  A 

83 

67 

33 

50 

50 

and  B 

7 

100 

100 

100 

86 

100 

100 

100 

71 

29 

71 

57 

and  H 

10 

80 

60 

100 

60 

80 

100 

60 

70 

40 

20 

40 

and  I 

9 

100 

77 

100 

89 

78 

100 

i  ' 

33 

56 

44 

56 

Average  for 
Total  Group 

127 

98 

Cl 

61 

92 

63 

81 

32 

78 

54 

98 

71 

"Tinnges  80-100 
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trait  ratines  excluding 


50-100  76-100  67-100  78-100  78-  1 00 Excl.N.R.’ 
13-10  29-  75  27-  56  20-  75  33-80  Incl.N.R.* 

oi_  thgse 
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if  datiT  are  based  on  absolute 
:  .the  instances  where  no  re- 


'agreement 

"'■•‘The  percentages  on  the  second  line  of  these  data  are  based  on  the 
absolute  agreements  in  the  trait  ratings,  including  the  instances  where 
jit, -response  was  made  on  both  as  an8"agreemcnt  ,  and  including  the 
instances  of.no-rcjjponsc  on  either  the  original  evaluation  or  re-e valua¬ 
tion  as  on  "inconsistency”.  These  percentages  are  viewed  as  much  more 
reflective  of  the  concept  of  reliability  than  the  former  ones. 


Inspection  of  the  data  in  Table  8  shows  first,  only  127  or  15  per 
cent  of  the  possible  total  number  of  inter-interviewer  evaluations  (872) 
were  made.  Hence,  the  findings  may  be  viewed  only  ns  suggestive  of 
possible  trends. 

It  is  seen  that  there  is  a  very  high  degree  of  consistency  among 
raters  with  regard  to  the  overall  decision--98  per  cent  agreement  on 
the  average.  All  three  of  the  disagreements  happened  to  be  in  the  No 
to  Yes  direction;  the  original  interviewer  did  not  accept  the  candidate, 
but  the  re-evaluator  did.  Again,  since  only  a  very  small  percentage  of 
the  candidates  arc  rejected,  this  high  degree  of  reliability  is  to  be  ex¬ 
pected. 

Diagnostically,  therefore,  it  might  be  well  to  "unmask",  as  it 
were,  the  indicated  high  reliabilities  of  the  overall  decision.  Qualitative¬ 
ly,  the  interview  comments  by  different  interviewers  had  shown  signs 
of  considerable  variability  in  individual  trait  judgments  from  interviewer 
to  interviewer.  When  their  comments  were  •'structured”  along  the 
first  interview  report  form,  from  Table  8  it  is  seen  that  the  inter-intcr- 
viewer  agreement  on  a  group  basis  for  the  five  traits  ranges  from  78  to 
98  per  cent,  excluding  instances  of  no  response,  a r.d  32  to  71  per  cent, 
including  instances  6f  no  response. 

Notwithstanding  the  high  reliability  of  the  overall  decision,  con¬ 
siderable  variation  in  what  may  best  be  termed  ‘‘standards  plus  report¬ 
ing  did  exist.  Thus  the  first  interview  report  form  was  designed  and 
instituted  to  overcome  at  least  this  kind  of  unreliability  which  was 
demonstrated  as  present  in  the  assessment  interview  ns  it  was  being 
conducted. 

5.  Reliability  of  aids  to  the  interview 

In  brief,  here,  findings  on  the  investigation  of  thereliability 
of  the  two  aids  to  the  interview,  the  Confidential  Questionnaire  and  the 
Submariner  Stereotype  revealed: 
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(1)  Fairly  high  and  acceptable  reliabilities  for  factual  type 
items  on  the  questionnaire; 

(2)  Low  and  unacceptable  reliabilities  for  items  of  the  non- 
fnctual,  or  attitudinal  type,  on  the  questionnaire. 

(3)  Acceptable  reliability  for  most  items  on  the  Sub¬ 
mariner  Stereotype. 

C.  Validity  of  the  interview 

1.  Prediction  of  success  in  Submarine  School 

Investigation  of  the  predictive  efficiency  of  each  inter¬ 
viewer  in  the  processing  of  a  group  of  692  submarine  candidates  during  the 
period  of  15  March  1951  to  15  July  1951  yielded  the  summary  pre¬ 
sented  in  T able  9. 


Table  9.-  The  total  number  of  interviewed,  accepted  and  rejected  submarine 
candidates  during  the  period  15  March  1951  to  15  July  1951,  and  the  effici¬ 
ency  of  the  predictions  for  each  interviewer  and  the  total  group  of  interviewers 
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96 

4  • 

24 

67 

13 

21 

40 

B 
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115 

98 

2 

1 1 

73 

0 

27 

33 

3 

C 

108 

96 

90 

10 

10 

80 

0 

20 

0 

2 

D 

72 

67 

91 

9 

5 

60 

0 

40 

0 

E 

44 

40 

100 

0 

2 

0 

0 

100 

0 

2 

F 

19 

16 

100 

0 

2 

50 

50 

0 

100 

1 

J 

53 

47 

96 
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33 

0 

67 

0 

K 

13 

13 

92 
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0 

0 
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L 

12 

12 

83 
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0 
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Examination  of  the  data  in  Table  9  shows  that,  on  the  whole, 
the  interviewers  identify  those  likely  to  pass  Submarine  School  with  95 
per  cent  success  and  5  per  cent  inaccuracy .  For  individual  interviewer s  . 
the  predictive  efficiency  ranges  from  83  to  100  per  cent. 


Inasmuch  as  the  interviewers  were  earmarking  borderline  easel, 

and  these  were  being  permitted  to  attend  Submar  ine  School,  then  the  fore¬ 
going  validity  data  need  to  be  supplemented  with  an  analysis  made  in 
terms  of  the  borderline  cases.  In  Table  10  below  are  presented  the  data 
on  identified  borderline  cases  for  each  interviewer  and  for  the  group  of 
interviewers  as  a  whole. 


Table  10.  -  The  total  number  of  interviewed,  accepted  cases  who  were 

identified  as  borderlines  and  the  percentages  of  these  cases 
who  graduated  and  did  not  graduate  from  Basic  Submarine 


Interviewer 

Code 

Total 

Accepted 
Number  of 
Borderlines 

% 

Passed 

F  ailed 

of  His  Total 
Number  of  Fail¬ 
ures  Identified 
as  Borderline 

A 

ie4 

28 

86 

14 

57 

B 

115 

12 

100 

0 

0 

C 

96 

21 

90 

10 

20 

D 

67 

3 

100 

0 

E 

40 

6 

100 

0 

F 

16 

1 

100 

0 

J 

47 

9 

89 

11 

50 

K 

13 

4 

75 

25 

100 

Total  ^Number 

606 

84 

76 

8 

31 

Group/Percentage 

PI 

~~rr~ 

V 

26  " 
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It  is  observed  from  the  data  in  Table  10  that,  of  the  14  per  cent 
of  the  accepted  candidates  who  are  identified  as  borderline,  91  per  cent 
succeed  in  graduating  from  Submarine  School  and  9  per  cent  fail  aca¬ 
demically.  Apparently,  taking  a  chance  on  the  “borderlines"  is  not 

wasteful. 

Now,  the  5  per  cent  who  are  accepted,  but  who  fail  academicals 

on  an  overall  basis,  it  is  found  that  26  per  cent  had  been  judged  as 
borderline  by  the  original  interviewer,  and  of  the  95  per  cent  who  are 
accepted  and  pass  academically,  1  3  per  cent  had  been  judged  as  border¬ 
line  by  the  original  interviewer.  Again,  considering  the  carefully  pre¬ 
selected  nature  of  the  submarine  candidate  group  and  the  high  selection 
ratio,  this  high  degree  of  forecasting  efficiency  should  be  regarded  as 
an  acceptable  minimum  of  validity  which  should  be  maintained  and  im¬ 
proved  upon,  if  possible,  by  observing  the  factors  related  to  reliability 
and  validity,  as  summarized  earlier  in  Section  A  of  these  results. 


D .  Isolation  of  relevant  traits 

The  first  interview  report  form  as  exhibited  in  Appendix  B 
constituted  the  first  approximation  of  tne  isolation  of  relevant  traits. 
In  the  interests  of  communicability  and  ease  in  rating,  these  were  identi¬ 
fied  as  five:  personal  adjustment,  adjustment  to  Navy  life,  motivation, 
interest  in  submarines  and  aptitude  for  submarines.  After  an  internal 
check-off  analysis,  evaluation  of  each  trait  was  made  along  a  4-point 
scale:  definite  reject,  conditional  pass,  definite  pass,  and  outstanding 
pass.  An  overall  judgment  was  then  made  on  a  4-point  scale:  recom¬ 
mend  unqualifiedly,  recommend,  recommend  with  reservations,  reject. 
Space  was  also  provided  for  additional  comments. 

It  is  added  here  that  the  staff  of  the  Medical  Research  Labora¬ 
tory  continued  to  develop  the  matter  of  isolating  relevant  traits  on  the 
basis  of  this  start,  and  the  present  rating  scheme  is  a  compilation  and 
definition  of  these  five  traits  and  two  additional  ones— maturity  and 

intelligence , 
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SUMMARY  EVALUATION 
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Investigation  of  the  reliability  and  validity  of  the  assessment 
interview  in  the  screening  and  selection  of  submarine  candidates  leads 
to  the  following  conclusions: 

A.  Reliability 

(1)  Interview  content  -  A  high  degree  of  consistent  coverage 

indicated  for  factual  type  items  of  questionable  assessment  value,  and 

available  on  other  forms;  low  consistency  in  the  coverage  of  altitudinal 

type  items  not  available  on  other  forms  which  may  prove  diagnostic. 

* 

(2)  Time  analysis  -  Considerable  variation  in  the  pntternof 
speaking  time  expenditures  of  the  interview  and  the  interviewee,  ' ‘dead*’ 
time  and  total  interviewing  time.  The  data  indicate  the  need  for  more 
interviewee  speaking  time  and  less  "dead"  time. 

(3)  Intra  -rater  consistency  -  High  reliability  in  overall  decision 
ts  suggested  bt/Tconsiderable  variation  is  indicated  in  individual  trait 
ratings,  best  described  as  "standards  plus  reporting". 

(4)  Inter-rater  consistency  -  High  reliability  in  overall  decision 
is  suggested  but  great  variation  is  indicated  in  individual  trait  ratings, 
best  described  as  "standards  plus  reporting". 

(5)  Aids  to  the  interview  -  High  reliability  for  factual  items  but 
low  reliability  for  items  of  the  personality  characteristic  type  on  the 
Confidential  Questionnaire;  acceptable  reliability  for  most  items  of  the 
Submariner  Stereotype. 

G.  Validity 

(1)  The  Assessment  Interview  -  Interviewers  ate  predicting 
graduation  from  Submarine  School  with  95  per  cent  accuracy  and  5  per 
cent  inaccuracy.  However,  of  the  latter,  26  per  cent  had  been  identified 
as  borderlines,  and  of  the  former,  13  per  cent  had  been  identified  as 
borderlines.  Therefore,  in  the  case  of  borderlines ,  a  chance  may  be  taken. 

(2)  Aids  to  the  interview  -  predictive  value  indicated  for  items 
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showing  educational  attainment  on  the  Confidential  Questionnaire  using 
the  criterion  of  graduation  from  Basic  Submarine  School;  no  interpretable 
predictive  value  indicated  for  present  items  of  the  Submariner  Stereo¬ 
type  using  the  same  criterion^  the  adequacy  of  which,  however,  is  ques¬ 
tionable  for  the  technique. 

The  significance  of  these  findings  is  that  although  the  predictions 
of  the  assessment  interview  as  it  was  being  conducted  at  the  Medical 
Research  L  aboratory  were  quite  accurate,  this  is  partially  an  artifact 
of  an  unusually  high  selection  ratio.  Improvement  in  the  general  pattern 
of  conducting  the  interview  may  be  indicated  by  the  following  measures: 

(1)  By  employing  the  information  available  on  the  Confidential 
Questionnaire  to  a  greater  extent  as  pre-interview  content  to  be  scan¬ 
ned  in  obtaining  information  about  the  candidate; 

(Z)  By  judiciously  using  the  validity  indicated  for  the  item  of 
educational  attainment  on  the  Confidential  Questionnaire  ns  the  particular 
situation  demands; 

(3)  By  devoting  the  available  interview ing  time  to  potentially 
more  diagnostic  attitudinal-type  inquiries; 

(.;)  Concurrently,  by  letting  the  interviewee  do  more  of  the  talking; 

(5)  By  using  such  scmi-structured  rating  forms  as  were  develop¬ 
ed  as  a  result  of  the  present  investigation; 

(6)  By  isolating  the  traits  relevant  to  success  in  the  submarine 
service  and  clarifying  their  meaning  and  methods  of  identification  from 
interviewer  to  interviewer. 

SUGGESTIONS  FOR  FURTHER  RESEARCH 

Probably  the  most  crucial  aspect  of  the  present  research  which 
was  not  explored  involves  obtaining  measures  of  performance  of  indi¬ 
viduals  in  the  submarine  fleet  itself.  This  ultimate  criterion  measure 
is  obviously  the  one  against  which  the  assessment  interview,  as  well  as 
the  other  predictor  measures,  must  be  checked.  A  kindred  problem 
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involves  the  determination  of  the  relative  uniqueness  of  the  assessments 
made  in  the  interview.  This  calls  for  a  correlational  study  of  the  inter¬ 
view  with  other  existing  or  contemplated  assessment  techniques,  c.g., 
the  psychological  tests  comprising  the  Basic  Navy  Battery. 

While  the  above  are  problems  untapped  within  the  scope  of  the 
present  study,  other  problems  suggest  themselves  as  outgrowths  of  the 
investigation.  For  example,  now  that  the  interview  is  a  semi-structured 
form,  it  would  be  desirable  to  know:  (1)  the  relative  amount  of  overlap 
among  the  individual  traits  presently  being  rated;  (2)  the  degree  of 
relationship  between  the  ratings  on  each  trait  and  the  overall  assessment; 
(3)  the  degree  of  the  relationship  between  the  ratings  on  each  trait  and 
the  overall  assessment  with  performance  in  Basic  Submarine  School. 

Other  avenues  of  research  on  the  interview  are: 

(1)  Educational  methods  for  increasing  the  reliability  and 
validity  of  interviewers’  predictions; 

(2)  The  characteristics  which  differentiate  successful  and  un¬ 
successful  interviewers; 

(3)  The  formulation  of  questions  which  will  elicit  information 
useful  in  the  assessment  of  prospective  submariners; 

(‘-)  Time  indices  as  possible  predictors  of  interviewer  per¬ 
formance;  ' 

(5)  Methods  for  reporting  the  results  of  the  interview  for  opti¬ 
mal  reliability  and  validity. 

Keynotes  for  research  tn  this  ere.  should  be:  (I  )Comprehensivc 
design  to  explore  the  many  facets  of  the  interviewing  problem;  end  (2) 
Temporal  continuity  to  insure  thet  cognizance  is  token  of  changeo  in  men- 
power  resources  and  requirements  in  the  submarine  fleet. 
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APPENDIX  A 


Interview  Report  Form  in  Use  at  the  Medical  Research  Labora¬ 
tory  upon  Activation  of  the  Present  Investigation. 
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APPENDIX  B 


First  Interview  Report  Form  Instituted  During  the  Present 
Investigation 


*&**>•&* 


INTERVIEW  FORM 


Inter  vifv.ee: 


Serial: 

Date: 


interviewer:  - - - - — 

Directions!  -  -  -  »- *~ 

also  on  your  overall  judgment.  So  (  ble  and  favorable  evidence 

to  different  examiners,  example  KUPPf bUvc  not  dejini- 

have  been  listed  under  each  trait.  J  -  — TTTcClar  heading  docTmTt 

tive.  The  number  of  oxcS  ‘  rated  “Outstanding  Fxospect”  with 
^dd  up  to  a  score.  A  m»n  ma)  be  ^  may  be  rated  “Definite  Re- 

relativcly  few  items  checked  Anoth  yyou  nrc  asked  to  check 

Observed  evidence  not  listed. 

SUMMARY 

Dcf.RO.  Gond.P&s  s  EiESSi  2“L£“i' 


Personal  Adjustment 
Adjustment  to  Navy  Life 
Motivation 

Interest  in  Submarines 
Aptitude  for  Submarines 
OVERALL  JUDGMENT: 


LJ 


ci  Cl 

1C 

□ 

□ 

I  l  o 

Cj 

O  Cl 

CD 

OVERALL  JUDGMENT:  j - 1 

o 

o 

□ 

1 ,  Pe r sonal  Adjustment 

Definite  Reject  Conditio naU^l 

n  □ 


Recommend  unqualifiedly 
Recommend 

Recommend  with  reservations 

Reject 

s  Definite  Pass  Outstanding  Prospect 

n  □ 
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Unfavorable 


Favorable 


Physical  F actors 


'  *j  excessive  sweating; 

CHj  tremors;  nail  biting; 

I  i  masked  evasiveness  of  manner; 
l  i  unkempt;  unclean; 

C "  Cl  underdeveloped; 

1  "  i  effeminate  build; 

. ''i  too  neat; 


i  j  normal  tonus; 

■.  -i  good  physique  and  carriage; 

t  i  good  posture; 

i  1  normal  equilibr atory  responses; 
l  1  clean  and  well  groomed; 

■  1  skin  in  good  condition; 

CH)  not  too  neat; 


Additional  Evidence: 


Psychiatric  Factors 


dm  immature  outlook; 

1  ■  goals  unrealistic; 

Cm*  fails  to  face  reality; 

Cm  emotions  of  child; 

i""  . t  undue  anxiety  over  future; 

Cm  disorganized  personality; 
Cm  lacks  confidence  in  sex  role; 


t- -- 1  mature  perspective;  goals  realistic 

Cm  controlled  emotional  responses; 

l - 1  cohesive  organized  personality; 

Cm  assurance  in  sex  role; 


Additional  Evidence: 


Psychological  and  Sociological  Factors 


I|  gross  family  instability; 

Ii  broken  home; 

:«*v.ifc  trouble’; 

marked  sibling  rivalry; 

Cm  history  of  psychiatric  complaints 
in  family; 

Cm  over-dependence  on  family; 
Additional  Evidence: 


mm 


normal  home  and  home  life; 
relatively  independent  of  parents; 
health  history  of  family  normal; 
adapted  well  to  undesirable 
family  situation; 


2.  Adjustment  to  Navy  Life 

Definite  Reject  Conditional  Pass 


Definite  Pass  Outstand  Prospect 


•iavwu*.  4. 


tf  4?5  *-•  .«  W&v  41.  <44*  ttMHMttdiia#  *»  jaat 


Factors  from  Man's  Record 


.4-viSSSw 


! 


Record  of  recurrent  offenses;  l  - 3  clean  record; 

Has  sought  many  changes  of  rate  . _ meritorius  mast;  few  changes 

and  station;  in  plans  of  rate  and  station; 

i  i  advancements  in  rate; 


Additional  Evidence: 


Psychological  Factors 


I  i  rebels  against  authority; 

I  i  carried  chip  on  shoulder  against 
_  Navy; 

1 - *  no  concern  about  oun  advancement; 

I - 1  “non-reg"  in  appearance  and 

manner; 

L  over-resentment  at  recall  to  duty; 

C  J  financial  hardship  at  recall; 


i— I  accepts  authority; 

l— — J  military  bearing  and  manner; 

>  i  wants  to  make  Navy  his  career; 
i - »  concern  about  advancement; 


Additional  Fvidencc: 


Social  Factors 


“lone  wolf"  on  job  and  on  liberty; 
not  accepted  by  shipmates; 
does  not  make  friends  easily; 
extreme  extroversion; 


Additional  Evidence: 


"team  player"; 
popular  with  shipmates; 
likes  group  functions; 
meets  new  people  easily; 
not  too  extroverted; 


3.  Motivation 

Definite  Reject  Conditional  Pass  Definite  Pass  Outstanding  Prospect 

□  □  □  □ 
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Unfavorable 


F  avorable 


Psychological  Factors 

"stick-to-it-ive  ness”; 
high  level  of  energy  and  well 
diroctionalized; 
stable  and  acceptable  value 
pattern; 

accomplishes  more  than  aptitud 
level  warra  .ts; 

aptitudes; 

Additional  Evidence:  _ _ 


"grasshopper  pattern”; 
fails  to  follow  through  on  tasks 
completion; 

energy  level  low  -  lethargic; 
does  just  enough  to  get  by; 
no  evident  value  pattern; 
fails  to  work  up  to  level  of 


Sociological  Factors 

'  I  Fails  to  share  group  goals;  [  — |  adjusts  well  in  group  operation; 

i  i  selfish;  r— — i  abie  to  subserve  personal  goals 

cm  negativistic; 

Additional  Evidence:  _ _ 


4.  Interest  in  Submarines 

Definite  Reject  Conditional  Pass 

□  □ 

Unfavorable 

impulsive  decision  to  "sign  up”; 
romantic  notion  of  life  on  board; 
put  ir.  for  subs  to  avoid  difficult 
adjustment  elsewhere; 
never  been  on  board; 

Additional  Evidence: 


Definite  Pass  Outstanding  Prospect 

□  □ 

F  avorablc 


realistic  picture  of  submarine 
based  upon  visiting  on  board; 
friends  or  relatives  in  subs; 
has  read  about  subs  and  their 
record  in  World  War  II; 


5.  Aptitude  for  Submarines 

Definite  Reject  Conditional  Pass  Definite  Pass  Outstanding  Prosper 

□  □  □  □ 


Factors  from  Record 


CT2  Low  CCT ; 

£ — 1  low  mcchnical  aptitude; 

1  poor  grade  school  and  high  school 
record; 


Psychological  Factors 


J  high  GCT;  generally  high 
level  scores; 

1  grade  school  and  high 
school  record  high; 


1 — -  has  poor  grasp  of  mcchnical 

principles; 

^ . (  disliked  study  in  school; 


Additional  Evidence; 


6.  Overall  Judgment 


_ i  “gadgeteer”; 

— ■  good  grasp  of  mechanics, 
has  studied  on  his  own; 

ZD  acquired  general  knowledge 
of  principles  of  buoyancy; 


j  Recommend  unqualifiedly 


Remarks: 


Recommend 


□  R  ecommer.d  with  reservations 
_  Reject 


doctor's  signature] 
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AFPEND1X  C 


First  Revision  of  Interview  Report  Form  Instituted  During  the 
Present  Investigation 
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INTERVIEW  FORM 


(FORM  2) 


Interviewee: 

Interviewer: 


Directions:  --  'i  ou  are  asked  to  rate  the  man  on  each  of  five  traits  and  also  on 
your  overall  judgment.  So  that  words  may  mean  the  same  thing  to  different 
examiners,  example  of  unfavorable  and  favorable  evidence  have  been  listed  un- 
cer  each  trait.  These  lists  are  suggestive  not  definitive.  The  number  of  boxes 
checked  under  a  particular  heading  does  not  add  up  to  a  score.  A  man  may  be 
rated  ‘‘Out standing"  with  relatively  few  items  checked.  Another  man  may  be 
•'Poor”  with  the  some  number  of  check  marks.  You  are  asked  to  check  the 
evidence  you  observe  and  to  add  any  observed  evidence  not  listed.  Complete 
the  form  during  or  immediately  after  the  interview. 


SUMMARY 


Personal  Adjustment 

Outstanding 

1  j 

Good  Adequate 

n  □ 

^oor 

□ 

Adjustment  to  Navy  Life 

□ 

□  □ 

□ 

Motivation 

D 

□  D 

D 

Interest  in  Submarines 

□ 

□  □ 

□ 

Aptitude  for  Submarines 

□ 

□  □ 

□ 

OVERALL  JUDGMENT: 

Cl 

Recommend  unqualifiedly 

□ 

Recommend 

□ 

Recommend  with  reservation 

Cl 

Not  recommended 

NMRL  Rev.  12-51 
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Unfavorable 


Favorable 


1.  PFRSONAL  ADJUSTMFNT 


Physical  Factors: 

r77~i  excessive  sweating 
r~~~i  tremors 
CZ1  nail  biting 

. - “i  marked  evasiveness 

of  manner 

>  i  underdeveloped 

I - 1  effeminate  build 

i - 1  too  neat 

\  >  sloppy 

1  '~"i  poor  posture 

i  '  hypertension 

i  i  acne 

I - 1  tense  and  blocked 


\  unmrwhat  sloppy 
I - 1  fair  posture 


—i  normal  tonus 

_  good  posture,  physique 

- 1  and  carriage 

|  normal  equilibvatory 
response 

_ _ (  clean  and  well  groomed 

u~~~'  6kin  In  good  condition 
jzz|  good  overall  impression 


Additional  FA-idence: 


Psychiatric  Factors: 

CZD  immature  outlook  ; - 1  poverty  In  child- 

t  goals  unrealistic  hood 

CZ}  fails  to  face  reality 

{ — 1  emotions  of  child 

CZD  undue  anxiety  over  future 

■  J  disorganized  personality 

r~~ 1  lacks  confidence  in  sex  role 

C  1  extremely  shy 

Additional  Evidence: _ _ _ _ _ _ 


.  mature  perspective 
goals  realistic 
controlled  emotional 
responses 
cohesive  organized 
personality 
assurance  in  sex  role 


Psychological  and  Sociological  Factors: 

. - ,  gross  family  insta-  ! - .unab'e  to  get 

CZ3  *  bUity  a  full  story 

L '  -I  broken  home 
CZ)  ••wife  trouble" 

CZ5  marked  sibling  rivalry 

history  of  psychiatric  com¬ 
plaints  in  family 
— 1  over-dependence  on  family 
(ZZt  parental  hostility 

Additional  Evidence: _ 


-  normal  home  and  home 

life 

, - i  relatively  independent 

of  parents 

■ - 1  health  history  of  fam¬ 

ily  normal 

f„ adapted  well  to  undosir 
able  family  situation 


Outstanding 

□ 

' 1  ’  '  ***"'*••  * 


Good 

Adequate 

Poor 

□ 

□ 

□ 
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D  DOOOO 


2.  ADJUSTMENT  TO  NAVY  LIFE 
Factors  from  Man’s  Record: 

i - 1  clean  record 

| _ j  meritorious  mast; 

few  changes  in 
plans  of  rate  and 
station 

■ _ 1  advancements  in 

rate 


Additional  Evidence: 


Psychological  Factors: 


1 - 1 

record  of  recurrent  , - , 

insufficient  ser¬ 

offenses 

vice  to  evaluate 

CZD 

has  sought  many  changes) - , 

occasional  minor 

of  rate  and  station 

offenses 

=> 

denies  disciplinary 
problem 

czz> 

Addi 


rebels  against  authority 
carried  chip  on  shoulder 
against  Navy 
no  concern  about  own 
advancement 
"non-reg”  in  appearance 
and  manner 

over -resentment  at  recall 
to  duty 

financial  hardship  at 
recall 

suspected  hostility 
tional  Evidence: 


Social  F actors: 


accepts  authority 
military  bearing 
and  manner 
wants  to  make  Navy 
his  career 
concern  about 
advancement 


“lone  wolf''  on  job  and 
on  liberty 

not  accepted  by  shipmates 
does  not  make  friends  easily 
extreme  extroversion 
preoccupied  with  his  per¬ 
sonality  defects 
no  sport  or  group  activity 


! - ,  “team  player” 

i - ,  popular  with  ship¬ 

mates 

p- — )  likes  group  function 

i - 1  meets  new  people 

eesily 

r — |  not  too  extroverted 
i - |  eusy  to  talk  to 


Additional  Evidence: 


Outstanding 

Good 

Adequate 

Poor 

□ 

□ 

□ 

□ 

SI 


Unfavorable 

3.  MOTIVATION 

Psychological  Factors: 

l~ — [  “grasshopper  pattern” 

I - 1  fails  to  follow  through 

on  task  completion 

I - 1  energy  level  low  - 

lethargic 

|  does  just  enough  to  get 
by 

l — in" -*1  n°  ev'^cn*  va^ue  pattern 

i - 1  fails  to  work  up  to 

level  aptitudes 

i . . |  low  motivation  for  USN 

Additional  Evidence: 


F  nvorablc 


, - jUnablc  to  detor- 


E=n 


mine 

undecided  about 
Navy 


EZD 

CZ? 

CZD 


CZj 


“stick-to-it-ive  lies  s 
high  level  of  energy 
well  directionalise d 
stable  and  acceptable 
value  pattern 
accomplishes  more 
than  aptitude  level 
w  ar rants 


Sociological  F actors; 


1 - 1  fails  to  share  group  goals 

-J  selfish 
£— -1  negativistic 

Additional  Fvidence: 

CD 

adjusts  well  in  group 
operation 

cBlc  to  subserve  p»T- 
sonal  goals 

Outstanding 

Good 

Adequate 

Poor 

□ 

'  '  □ 

□ 

□ 

4.  INTEREST  IN  SUBMARINES 


i - r  impulsive  decision  to 

“sign  up” 

r— ;  romantic  notion  of  life 
on  board 

i - !  put  in  for  subs  to  avoid 

difficult  adjustment 
elsewhere 

i - ;  never  been  on  board 

; - 1  poorly  oriented 

r . -]  unable  to  give  reasons 

for  applying 
Additional  Evidence: 


i - 1  motivated  principally  by 

personal  advantages 

i~" .  i  vague  ideas 

I - 1  may  abandon  if  desired 


CZZI 


realistic  picture  of 
submarines  based 
upon  visiting  on 
board 

friends  or  relatives 
in  subs 

has  read  about  subs 
and  their  record 
in  V/WII 
been  to  sea 


mh- 

R'l'ter'" 


Outstanding 

1 

Good 

Adequate 

Poor 

.f  □ 

r— — t 

□ 

06 

□ 

□ 

,.<S 


% 


I 

4 


Unfavorable 

5.  APTITUDE  FOR  SUBMARINES: 


F  avorable 


Factors  from  Record: 


T - 1 

low  GCT 

1 - 1 

low  mechanical  aptitude 

nz) 

poor  grade  school  and 

a 

high  school  record 

nzj 

poor  school  record  with 
high  GCT 

EZZl 

high  GCT;  generally  high 
level  test  scores 
grade  school  and  high 
school  record  high 
excellent  school  and  work 
record  with  low  GCT 
excellent  school  and  work 
record;  low  GCT 


Psychological  Factors: 


I - 1  has  poor  grasp  of  mcch-  L - I  fair  L . 

anical  principles  grasp 

- — i  disliked  study  in  of  mech-- 

school  anics 


“gadgeteer” 
good  grasp  of  mechanics 
has  studied  on  own 
acquired  general  knowledge 
of  principles  of  buoyancy 
good  overall  knowledge 
submarines 
interest  in  related 
sciences 


Additional  Evidence: 


Outstanding 

Good 

Adequate 

Poor 

□ 

□ 

□ 

□ 

6.  SFR VICE  SCHOOL  RECORD: 

(Type  of  School  ) 

Upper  one-fourth 
Middle  one-half 

Lower  one-fourth 
History  of  having  failed 

Remarks: 


u 

□ 

u 


7.  OVERALL  JUDGMENT 


□ 

□ 

□ 

u 


Recommend  unqualifiedly 
Recommend 

Recommend  with  reservations 
Not  recommended 
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SUB.  SCHOOL  PREDICTION: 


Upper  quarter 
Middle  half 


□ 

□ 

□ 


Lower  Quarter 


APPENDIX  D 

Table  1.-  THE  RELATIVE  DEGREE  OF  CONSISTENCE  IN  THE  COVER¬ 
AGE  OF  EXISTENT  SUBJECT  MATTER  THROUGHOUT  109  INTER¬ 
VIEWS  WITH  CANDIDATES  FOR  THE  SUBMARINE  SERVICE  DURING 
THE  PERIOD  15  MARCH  1951  TO  15  JULY  1951,  AND  THROUGHOUT 
THE  INTERVIEWS  OF  EACH  INTERVIEWER. 


Section  1.  Family  Background 
Section  2.  Personal  Background 
Section  3.  Educational  Background 
Section  4.  Work  Experience 
Section  5.  Navy  -  Submarine  Service 
Section  6.  Physical  Condition 


I“blmiucr: ft/ou'w  Bt  in  the  co.cr.gc  of  existent  ,«b- 

-  srsa  a  M=a=  k. 


SECTION  : 


FAMILY  BACKGROUND 

Total 

N=  1 09 

A 

N=43 

B 

N=21 

C 

N=20 

I) 

N=  1 5 

E  F 

N-5  N=5 

Parents  -  Living, 
deceased,  sep¬ 
arated 

70 

60 

76 

85 

87 

20  60 

Health 

15 

5 

55 

20 

40 

Residence  of  Parents 

8 

9 

14 

5 

7 

Mobility 

1 

5 

Home  Pre- service 

15 

16 

38 

20 

Home  atmosphere 

7 

12 

5 

5 

7 

Rearing  methods 

5 

5 

7 

40 

Visit  during  service 

5 

5 

10' 

• 

20 

Home  correspondence 

5 

9 

7 

Closest  parent 
sided  with 

2 

2 

5 

Mother's  occupation 

6 

2 

5 

7 

Personality  of 

Mother 

5 

Attitude  toward  Mother 

4 

5 

Mothers  Attitude  toward 
sub  service 

50 

65 

33 

35 

47 

60  40 

Relationship  with  Mother 

1 

7 

5 

10 

20 

20 

Father's  occupation 

43 

39 

62 

55 

7 

40  60 

Personality  of  Father 

1 

5 

Attitude  toward  Father 

5 

2 

10 

5 

20 

Father’s  attitude  toward 
sub  service 

37 

49 

24 

20 

40 

40  40 

Relationship  with  Father 

16 

12 

33 

15 

40 

Father’s  income 

2 

2 

5 

Siblings  -  number 

..] 

72 

90 

80 

100 

80  60 

Relative  position  in  family 

54 

37 

67 

55 

87 

60  40 

63 
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Table  1.  -  The  relative  degree  of  consistency  in  the  coverage  of  existent  subject 
matter  throughout  109  interviews  with  candidates  for  the  submarine  service  dur¬ 
ing  the  period  15  March  1951  to  15  July  1951,  and  throughout  the  interviews  of 
each  interviewer. 


SECTION  2: _ 

PERSONAL  BACKGROUND 

Age _ 

Nationality 

Religion _ 

Religious  observance 

Birthplace 

Hometown 

Kind  of  place 

Time  in  residence 

Civilian  difficulties 

Marital  status 

Age  at  first  intercourse 

Homosexual  experience 

Attitude  toward  homosexuals 

Political  membership 

Other  organizational  membership 

Earliest  recollection 

Excitement  activity 

Travel  experi e nc e 

What  wants  out  of  life 

Behaviour  when  angry 

Bad  habits 

People  upset  him  most 

Three  most  treasured  possessions 

Outstanding  accomplishments 

Owns  a  car _ 

Ridden  a  motorcycle  _ 

Hot  rods  _ 

Habits  of  saving  money  _ 

People  most  admires 


Total  ABC  D  E  F 
Nr  1 09  N=43  Nr21  N=20  Nr15  Nr5  Nr5 

6  _ 5  15 _ 40  20 

4 _ 5 _ 10 _ 

7  _  20  20  80 

7  20  20  80 


20  80 
7  40 


93  100 


7  20 
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Ta}.le  1;-  relative  degree  of  consistency  in  the  coverage  of  existent  mb- 
iir!  ITiat.ter  .t^rou8h,out  10<?  interviews  with  candidates  for  the  submarine  ser- 

1951  to  15  Juiy  i95i>  and  throu«hout  ^ 

SECTION  3: _ 

EDUCATIONAL  BACKGROUND  N-109  N-43  N-21  N-^20  N^IS  N^S  N^5  ' 

14  t  nK  CaLaa!  r  .11  . . . 


High  School-College 

Age  at  leaving _ 

Reason  for  leeving 
Major  interest 
Reason  for  interest 
Favorite  subjects 
F ailed  subjects 
Academic  standing 
Work  through  school 
Extra-curricular  activities 
^tlnhetic^cctivities^ 

SECTION  *:  _ 

WORK  EXPERIENCE 

Position  (s )  _ 

Company  - place 
Lencth  of  time  in  >b(*) 

Interest  in  iobfa} _ 

Income  from  jobls) _ 

Family  dependence _ 

Reason  for  leaving 


67  100 


t.  kj— *.  : 


APPENDIX  D 


Table  1,-  The  relative  degree  of  consistency  in  the  coverage  of  existent 
subject  matter  throughout  109  interviews  with  candidates  for  the  submarine 
service  during  the  period  15  March  1951  to  15  July  1951,  and  throughout 
the  interviews  of  each  interviewer. 

SECTION  5: 

- rsm — n - b - c — r> — e - r — 


NAVY  SUBMARINE  SERVICE 

N-109 

N-43 

N-21 

N-20 

N- 15 

N-5 

N-5 

Reason  for  entry  into  Navy 

43 

49 

38 

35 

20 

80 

80 

Length  of  service 

50 

60 

38 

40 

33 

100 

60 

Kind(s)  of  duty 

55 

77 

38 

50 

40 

60 

40 

Place(s)  of  duty 

50 

77 

57 

25 

13 

40 

20 

Adjustment-discipline 

36 

58 

38 

25 

7 

Leisure-time  activities 

35 

21 

48 

35 

60 

60 

Test  performance 

20 

9 

43 

7 

20 

20 

Rating 

23 

29 

35 

B3 

40 

20 

Future  plans  after  Navy 

34 

53 

5 

40 

60 

40 

Submarine-reason  for  interest 

83 

88 

76 

80 

87 

100 

60 

Time  of  interest 

34 

49 

5 

m 

47 

40 

40 

Contact  with  submarine  people 

41 

74 

24 

20 

13 

40 

Information  about  submarines 

15 

28 

15 

20 

Contact  aboard  submarines 

4t> 

63 

K 

25 

73 

60 

20 

Qualities  of  a  submeriner 

5 

5 

80 

Oualities  can  offer  submarines 

4 

80 

Certainty  of  desire  for  sub- 
marine  service 

16 

30 

5 

7 

20 

20 

Desired  position  on  submarine 

42 

37 

50 

33 

53 

60 

40 

Capable  of  making  submarines 

3 

10 

20 

Nature  of  submarine  life 

14 

14 

10 

10 

i 

40 

40 

Technical  knowledge  of  subs 

24 

14 

20 

10 

20 

Interest  in  related  sciences 

17 

16 

10 

10 

7 

100 

20 
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Table  1.-  The  relative  degree  of  consistency  in  the  coverage  of  existent 
subject  matter  throughout  109  interviews  with  candidates  for  the  sub¬ 
marine  service  during  the  period  15  March  1951  to  15  July  1951,  and 
throughout  the  interviews  of  each  interviewer. 

SECTION  6: 


PHYSICAL  CONDITION 

Total 

N-109 

A 

N-43 

”5“ 

N-21 

— c 

N-20 

D 

N- 15 

E 

N-5 

— pr— 

N-5 

jenoral  health 

17 

22 

14 

15 

40 

Complaints 

12 

12 

10 

20 

20 

20 

Illnesses 

10 

5 

19 

25 

Operations 

1 

2 

Allergies 

1 

5 

Accidents 

4 

5 

5 

5 

Communicable  diseases 

8 

5 

10 

25 

Headaches 

5 

12 

i-i 

Nervous  c  ondition 

23 

19 

14 

15 

13 

40 

20 

Drinking  habits 

0 

15 

20 

■40 

Smoking  habits 

3 

5 

20 

20 

Dental  condition 

-i 

10 

10 

Habits  of  cleanliness 

1 

20 

Phobias 

1 

20 

i 


